CN100511104C - Visual hallucination emulation positioning system based on touch - Google Patents
Visual hallucination emulation positioning system based on touch Download PDFInfo
- Publication number
- CN100511104C CN100511104C CNB2007101707715A CN200710170771A CN100511104C CN 100511104 C CN100511104 C CN 100511104C CN B2007101707715 A CNB2007101707715 A CN B2007101707715A CN 200710170771 A CN200710170771 A CN 200710170771A CN 100511104 C CN100511104 C CN 100511104C
- Authority
- CN
- China
- Prior art keywords
- touch
- emulation
- visual hallucination
- screen
- sense
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 208000004547 Hallucinations Diseases 0.000 title claims description 100
- 239000006185 dispersion Substances 0.000 claims abstract description 7
- 210000003128 head Anatomy 0.000 claims description 17
- 239000000758 substrate Substances 0.000 claims description 16
- 238000009434 installation Methods 0.000 claims description 12
- 238000000034 method Methods 0.000 claims description 10
- 238000007405 data analysis Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 8
- 210000001061 forehead Anatomy 0.000 claims description 7
- NJPPVKZQTLUDBO-UHFFFAOYSA-N novaluron Chemical compound C1=C(Cl)C(OC(F)(F)C(OC(F)(F)F)F)=CC=C1NC(=O)NC(=O)C1=C(F)C=CC=C1F NJPPVKZQTLUDBO-UHFFFAOYSA-N 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 4
- 230000002093 peripheral effect Effects 0.000 claims description 2
- 230000004438 eyesight Effects 0.000 abstract description 18
- 230000000638 stimulation Effects 0.000 abstract description 7
- 230000000007 visual effect Effects 0.000 abstract description 5
- 230000004936 stimulating effect Effects 0.000 abstract description 4
- 230000004807 localization Effects 0.000 abstract 2
- 238000011156 evaluation Methods 0.000 abstract 1
- 101100347655 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) NAB3 gene Proteins 0.000 description 12
- 239000007943 implant Substances 0.000 description 8
- 210000001525 retina Anatomy 0.000 description 8
- 238000002513 implantation Methods 0.000 description 7
- 210000001328 optic nerve Anatomy 0.000 description 7
- 230000037361 pathway Effects 0.000 description 6
- 210000004556 brain Anatomy 0.000 description 5
- 238000012360 testing method Methods 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000008676 import Effects 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 230000009897 systematic effect Effects 0.000 description 3
- 210000000857 visual cortex Anatomy 0.000 description 3
- 206010064930 age-related macular degeneration Diseases 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 210000004027 cell Anatomy 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 210000001508 eye Anatomy 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 210000004247 hand Anatomy 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000011368 organic material Substances 0.000 description 2
- 230000007170 pathology Effects 0.000 description 2
- 238000005424 photoluminescence Methods 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 238000011002 quantification Methods 0.000 description 2
- 230000035484 reaction time Effects 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 238000001356 surgical procedure Methods 0.000 description 2
- 108010022579 ATP dependent 26S protease Proteins 0.000 description 1
- 241001269238 Data Species 0.000 description 1
- 201000007737 Retinal degeneration Diseases 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 210000003710 cerebral cortex Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000002964 excitative effect Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 210000003811 finger Anatomy 0.000 description 1
- 210000005224 forefinger Anatomy 0.000 description 1
- 239000011147 inorganic material Substances 0.000 description 1
- 229910010272 inorganic material Inorganic materials 0.000 description 1
- 238000013332 literature search Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000007830 nerve conduction Effects 0.000 description 1
- 210000004126 nerve fiber Anatomy 0.000 description 1
- 230000007383 nerve stimulation Effects 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 210000000869 occipital lobe Anatomy 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000004513 sizing Methods 0.000 description 1
Images
Landscapes
- Position Input By Displaying (AREA)
Abstract
A touch-based simulated false-vision positioning system in the technical field of visual prostheses comprises a helmet display, an auxiliary head positioning device, a touch screen, a computer, a touch navigation device and a touch panel. Firstly, the helmet display which is used as a stimulating source provides simulated false vision stimulation; with the auxiliary head fixing device, the head of a user is fixed opposite to where the touch screen is fixed; simulated false-vision generating software with an appropriate stimulating mode is selected and facilitates the computer to produce simulated false vision; after judging the positions of simulated false visions in the helmet display, the user points out the localization on the touch screen with the help of the touch navigation device or the touch panel; after feedback data is processed with corresponding software, analysis and evaluation on information such as localization accuracy, dispersion, etc. of simulated false visions sensed by touch can be obtained.
Description
Technical field
The present invention relates to a kind of system of vision prosthesis technical field, specifically, is a kind of visual hallucination emulation positioning system based on sense of touch.
Background technology
The formation of vision needs complete pathways for vision, comprise eyeball dioptric system, retina, look road and cerebral cortex occipital lobe.Any position generation pathology all can affect one's power of vision on the pathways for vision, and severe patient causes losing one's sight.Carrying out property of the ectoretina sex change that primary pigmentary degeneration of retina (RP) and senile macular degeneration (ARMD) cause becomes the main cause that causes the elderly to lose one's sight.The vision prosthesis technology is to utilize most of blind persons often to have only the part generation pathology of pathways for vision, and the still intact characteristics of the 26S Proteasome Structure and Function of remainder nerve fiber, intact position to pathways for vision applies specific artificial electrical stimulation, come excitatory cell, the effect of simulating nature light stimulus makes the blind person produce visual experience.
In neural engineering field, the electrode stimulating at three places can effectively cause recognizable visual hallucination on the pathways for vision: visual cortex, optic nerve and retina.The implantation of visual cortex is at brain visual cortex district implant electrode array, directly stimulates cerebral cortex to produce visual hallucination by electro photoluminescence.It then is that a hoop shape is twined the end that electrode places optic nerve that the optic nerve prosthese is implanted, and imports electro photoluminescence by one pole or bipolar electrode, and optic nerve imports stimulation into brain and produces visual hallucination.Retina is implanted and is divided under the retina and the preceding two kinds of prostheses implantation of retina mode, mode by implant electrode array on retina, by light signal or stimulating electrical signal retina cell, import brain into by optic nerve, thereby the generation visual hallucination, this implantation mode is had relatively high expectations to patient's pathways for vision integrality.In three kinds of implantation modes, what the space correspondence between the stimulation-visual hallucination was better implanted mode is that retina is implanted and the cortex implantation, but because the restriction of implant surgery method and degree of accuracy, after the stimulation of implant electrode, visual hallucination position that anticipation produces and actual observation to the visual hallucination position between also do not have strict corresponding relationship.And implant mode for optic nerve, because the complicacy of nerve conduction is still unclear for the spatial correspondence between the stimulation-visual hallucination of this kind implantation mode at present.
Increasingly mature along with vision prosthesis research, the visual hallucination locating device becomes the important means that helps blind person's training and rehabilitation after the implant surgery accurately and effectively.No matter use which kind of vision prosthesis to implant mode, in order more effectively to be the individual Useful Information that transmits of blind person, it is very crucial at the distribution plan in the true visual field to find out implantation back visual hallucination.
Find through literature search prior art, Veraart C etc. are in Brain Research (Chinese periodical name: the research of experiment brain) the Visual sensationsproduced by optic nerve stimulation using an implanted self-sizing spiralcuff electrode that delivers on (1998 the 813rd phase the 181-186 page), propose to assess the visual hallucination of the position of visual hallucination in this article with a hemisphere, be specially: measured's head is fixed on the dead ahead of hemisphere, the forefinger of a hand places point of fixity as reference point, and another is pointed out the observed visual hallucination point that arrives of eyes simultaneously.Its deficiency is: owing to must use a hand as reference point, during some positions visual hallucination point on indication hemisphere, must walk around the hand as reference point, the systematic error of formation this method.
Summary of the invention
The objective of the invention is at the deficiencies in the prior art, a kind of visual hallucination emulation positioning system based on sense of touch is provided.It is positioned visual hallucination emulation based on sense of touch, can carry out quantisation metric to the accuracy and the dispersion of visual hallucination emulation location, and the systematic error of quantification can be provided, for adjustment.
The present invention is achieved by the following technical solutions, the present invention includes: Helmet Mounted Display, head auxiliary locator, touch-screen, computing machine, sense of touch guider and touch pad.Described Helmet Mounted Display links to each other with computing machine, as the stimulus that produces visual hallucination emulation; Described head auxiliary locator is used for fixing the relative position and the angle of each user and touch-screen; Described touch-screen is used for writing down the sense of touch location of user after judging the visual hallucination position, and feeds back in the computing machine; Described sense of touch guider helps the user to determine the center of touch-screen; Described touch pad is arranged at the touch-screen top, is used for guiding auxiliary user to use visual hallucination emulation position, tactilely-perceptible location; Described computing machine produces the positional information of visual hallucination emulation point, be transferred in the Helmet Mounted Display by data line and show, the visual hallucination emulation point that the user arrives according to the observation, directly or under guider is auxiliary locate on touch-screen, touch-screen is sent to locating information in the computing machine by data line.
Described Helmet Mounted Display adopts Helmet Mounted Display HMD, and HMD is a universal models on the market, what the visual hallucination of generation can be for two dimension, also can be for three-dimensional.
Described head auxiliary locator is made of a rack-mount chin stationary installation and forehead stationary installation, can adjust the position of chin stationary installation and forehead stationary installation by the balance nut, be used for fixing the relative position and the angle of each user and touch-screen.
Described touch-screen range of size is 14 to 30 inches, is used for writing down the sense of touch location of user after judging the visual hallucination position.
Described sense of touch guider is a L type structure, its pedestal center fixed one long straight bar-shaped object is as support, cantilever tip is by the center of the fixing horizontal bar sensing touch-screen of adjustable nut, and long straight bracket and indication horizontal bar constitute L type structure, help the center that the user determines touch-screen.
Described touch pad, it is a substrate, this substrate hits exactly the push-button array that distributing, baseplate material can comprise various can the support keys array and bear the various inorganic of press pressure in the experimentation, organic material, array size in use can be according to the actual conditions adjustment such as resolution of touch-screen size and test request.At the Dian Chu of substrate center, the remarkable projection of guiding function has been arranged, around, the guiding key-top at diagonal line and far and near subregion place has projection, and in diagonal line, horizontal vertical separated time button at interval in, be provided with the guide line that constitutes by the organic glass fritter.And with the array center is the center, and the length and width that distributing are half length of array, the lead-frame that constitutes by the organic glass fritter equally, and these several persons constitute the sense of touch guide line of this touch pad jointly.Purpose is to understand the distribution of whole array fast for auxiliary user, thereby improves the speed and the accuracy rate of indication location.During use, be positioned over the touch-screen top, pressing keys indication visual hallucination position.
Described computing machine wherein is provided with selectable visual hallucination emulation stimulus modality module, visual hallucination emulation locator data logging modle and data analysis processing module.Selected stimulus modality starts the visual hallucination emulation position fixing process in visual hallucination emulation stimulus modality module, and this module is sent to the visual hallucination emulation positional information under the corresponding modes among the HMD and shows.Thereby the user can directly or under navigation is auxiliary locate on touch-screen according to the position of observed visual hallucination emulation point among the HMD.Touch-screen will be located related data again and will be sent to visual hallucination emulation locator data logging modle and data analysis processing module.The former carries out recorded and stored to locator data.The latter calculates and assesses locator data, and the information such as dispersion of output locator data also can be analyzed with the positional information of the original analog visual hallucination point of visual hallucination emulation stimulus modality module output, and information such as positional accuracy are provided.
When the present invention used, under no navigation mode, touch-screen was vertically placed on the user dead ahead, and between the user distance according to factor adjustment such as user's brachiums.The user directly touches the location on touch-screen.Visual hallucination emulation stimulus modality module produces the positional information of visual hallucination emulation point in the computing machine, be transferred among the Helmet Mounted Display HMD by data line and show, the visual hallucination emulation point that the user arrives according to the observation, touch the location on touch-screen, touch-screen is sent to visual hallucination emulation locator data logging modle and data analysis processing module in the computing machine with locating information by data line.
In the sense of touch navigation mode, touch-screen is vertically placed on the user dead ahead, and distance is according to factor adjustment such as user's brachiums between the user, and the sense of touch guider is positioned over the touch-screen dead ahead, top indication horizontal bar points to touch screen center, and horizontal bar one end can contact touch-screen.During use, the user is positioned over a hand on the sense of touch guider, and the another hand touches the location on touch-screen.Data transmission procedure is identical with no navigation mode.
In the touch pad navigation mode, touch-screen is placed horizontally on the platform in user dead ahead, and distance is according to factor adjustment such as user's brachiums between the user, touch pad is positioned over directly over the touch-screen, adjust the two relative position, so that the user locatees on touch-screen by pressing keys easily.During use, the user is positioned over both hands on the touch pad, by push respective keys on touch pad, locatees on touch-screen.Data transmission procedure is identical with no navigation mode.
Compared with prior art, the present invention has following advantage: the first, and can carry out quantisation metric to the accuracy and the dispersion of visual hallucination emulation location, and the systematic error of quantification can be provided, for adjustment.The second, can avoid adopting the right-hand man to cause the positioning error that spatial obstacle causes as the reference coordinate.The 3rd, can be used for the location assessment of visual hallucination emulation, the present invention uses the sense of touch location, and feedback system can be modes such as the appreciable sense of hearing of blind person, sense of touch by visual modification, the present invention can position assessment to the visual hallucination that vision prosthesis causes equally, can help the blind person who implants vision prosthesis that the implanting prosthetic effect is assessed.
Description of drawings
Fig. 1 is a structural representation one of the present invention.
Fig. 2 is a structural representation two of the present invention.
Fig. 3 is a head positioning device structure synoptic diagram.
Fig. 4 is a sense of touch guider synoptic diagram.
Fig. 5 is the touch pad structural representation.
Fig. 6 is a common key-press section of structure in the touch pad push-button array.
Fig. 7 is a guiding press-key structure sectional view in the touch pad push-button array.
Fig. 8 is a workflow diagram of the present invention.
Illustrate: 1-Helmet Mounted Display HMD, 2-head auxiliary locator, 3-touch-screen, 5-sense of touch guider, the 6-touch pad, 7-forehead fixed band, 8-chin stationary installation, 9-head auxiliary locator support, 10-head auxiliary locator setting nut, 11-head auxiliary locator pedestal, 12-sense of touch guider setting nut, 13-sense of touch guider top indication horizontal bar, 14-sense of touch guider support, 15-sense of touch guider stand base, 16-touch pad substrate, 17-touch pad push-button array, the center indication key of 18-touch pad, the guide line of 19-touch pad, 20-cambered surface projection, 21-spring, the 22-spring detent, the 23-guide protrusion, the 24-common key-press, 25-guides button.
Embodiment
Below in conjunction with accompanying drawing embodiments of the invention are elaborated: present embodiment has provided detailed embodiment and process being to implement under the prerequisite with the technical solution of the present invention, but protection scope of the present invention is not limited to following embodiment.
Shown in Fig. 1-2, present embodiment comprises Helmet Mounted Display HMD1, head auxiliary locator 2, touch-screen 3, computing machine 4, sense of touch guider 5 and touch pad 6.Head auxiliary locator 2 is fixed in the edge of a platform, and after the user had worn Helmet Mounted Display 1, this head auxiliary locator 2 regular user's head positions were regulated towards head auxiliary locator 2 in Helmet Mounted Display 1 front.Described Helmet Mounted Display 1 links to each other with computing machine 4, as the stimulus that produces visual hallucination emulation; Described head auxiliary locator 2 is used for fixing the relative position and the angle of each user and touch-screen 3; Described touch-screen 3 is used for writing down the sense of touch location of user after judging the visual hallucination position, and feeds back in the computing machine 4; Described sense of touch guider 5 helps the user to determine the center of touch-screen 3; Described touch pad 6 is arranged at touch-screen 3 tops, is used for guiding auxiliary user to use visual hallucination emulation position, tactilely-perceptible location; Described computing machine 4 produces the positional information of visual hallucination emulation point, be transferred to demonstration in the Helmet Mounted Display 1 by data line, the visual hallucination emulation point that the user arrives according to the observation, directly or at sense of touch guider 5 assist location on touch-screen 3 down, touch-screen 3 is sent to locating information in the computing machine 4 by data line.
Described Helmet Mounted Display HMD1 can use present generic brand.Link to each other with computing machine 4, as the simulation stimulus that produces visual hallucination, what the visual hallucination emulation of generation can be for two dimension, also can be for three-dimensional.
As shown in Figure 3, described head auxiliary locator 2 is made of pedestal 11, support 9 and the chin stationary installation 8 and the forehead fixed band 7 that are installed on the support 9, the position of chin stationary installation 8 and forehead fixed band 7 can be adjusted by setting nut 10, is used for fixing the relative position and the angle of each user and touch-screen 3.
Described touch-screen 3 range of size are 14 inches to 30 inches, and the user is used for writing down the sense of touch location of user after judging the visual hallucination position after judging the visual hallucination position.
As shown in Figure 4, described sense of touch guider 5 is the L type, constitute by pedestal 15, support 14 and horizontal bar 13, pedestal 15 center fixed one long straight bracket 14, support 14 tops are fixed with horizontal bar 13 by setting nut 12, regulate horizontal bar 13 positions, top by setting nut 12, make it point to the center of touch-screen 3, long straight bracket 14 and horizontal bar 13 constitute L type structure, help the center that the user determines touch-screen.
As shown in Figure 5, described touch pad 6 is made of the push-button array 17 and the guide line 19 of substrate 16 and distribution on it, can be used to guide auxiliary user to use visual hallucination emulation position, tactilely-perceptible location, the size of push-button array and the number of button can design according to touch-screen size and specific requirement resolution, the scope of number of keys is 4 * 4 to 100 * 100, and key position is by touch-screen 3 records.
As shown in Figure 6, the push-button array 17 of guiding sense of touch location is positioned at touch pad 6 centers on the described touch pad 6, is made of common key-press 24, guiding button 25 and center indication key 18, and all buttons all can be pressed, by touch-screen 3 record key positions.After these buttons helped the user by tactilely-perceptible the visual hallucination emulation among the Helmet Mounted Display HMD1 to be judged, the location pushed button.Its size and resolution can be according to concrete request for utilization adjustment, and the scope of number of keys is 4 * 4 to 100 * 100.
As shown in Figure 7, described center indication key 18 is positioned at the center of push-button array 17, is made of the key body that cambered surface projection 20 is arranged, spring 21 and spring detent 22.Button is installed on the radius that has made on the substrate 16 and is slightly larger than in the hole of button, the top projection is higher than plane on the substrate 16, middle part key body and be located in the substrate aperture around the spring 21 1 of middle part key body, spring detent 22 is fixed in the key body bottom of stretching out substrate 16 lower planes.Center indication key 18 exceeds push-button array 17 plane 2-10mm, and it specifically highly can help the user to judge push-button array 17 centers fast according to the request for utilization adjustment.
Described common key-press 24 is made of the key body that cambered surface projection 20 is arranged, spring 21 and spring detent 22.Common key-press 24 structures are identical with center indication key 18 with installation.Common key-press 24 provides the sense of touch navigation, and the user can be positioned at observed visual hallucination emulation among the Helmet Mounted Display HMD1 by pushing button.
Described guiding button 25 is made of the key body that guide protrusion 23 is arranged, spring 21 and spring detent 22.Guiding button 25 structures and installation are similar to the center indication key.Guiding button 25 being distributed as in push-button array 17: peripheral four limits, two diagonal line, horizontal central line, median vertical lines and the length and width that are positioned at push-button array 17 central authorities are respectively half four limits of little frame of push-button array 17 length and width.Guiding button 25 can guide the user to judge the areal distribution of push-button array 17 fast.
Help the guide line 19 of location fast on the described touch pad 6, guide line 19 is to use the fritter with touch pad 6 same material, and also can use and can bear finger presses pressure, and the organic or inorganic material that can on substrate 16, fix, be fixed on the substrate 16.The distribution of guide line 19 on substrate 16 is identical with guiding button 25, and 19 of guide lines are present in the zone of the push-button array 17 that distributed on the substrate 16.Guide line 19 helps the user to judge the areal distribution of push-button array 17 fast with guiding button 25.
As shown in Figure 8, when the present embodiment system uses, the user is put in chin on the chin stationary installation 8 of head auxiliary locator 2, adjust the setting nut 10 on the locating device, make user's eyes be in identical horizontal level with touch-screen 3 centers, fixedly the forehead fixed band 7, guarantee that the head position of user in the whole use is fixed.The user wears Helmet Mounted Display HMD1, at the selected suitable stimulus modality of computing machine 4 existing visual hallucination emulation stimulus modalities, also can set up new stimulus modality on their own by the user.After stimulus modality was opened, the user can observe corresponding modes in HMD1 visual hallucination emulation stimulated.At last, after the user has adapted to the visual hallucination emulation stimulation, can formally bring into use above-mentioned sense of touch guider 5 and touch pad 6 to carry out the visual hallucination emulation location, by the position data of touch-screen 3 to computing machine 4 output touches.Simultaneously, computing machine 4 will write down and analyze from touch-screen 3 input locator datas, and the user can check the raw data of locator data, also can check data analysis results such as degree of accuracy and dispersion.
Described computing machine wherein is provided with selectable visual hallucination emulation stimulus modality module, visual hallucination emulation locator data logging modle and data analysis processing module.During use, selected stimulus modality starts the visual hallucination emulation position fixing process in visual hallucination emulation stimulus modality module.This module is sent to the visual hallucination emulation positional information under the corresponding modes among the HMD and shows.Thereby the user can directly or under navigation is auxiliary locate on touch-screen according to the position of observed visual hallucination emulation point among the HMD.Touch-screen will be located related data again and will be sent to visual hallucination emulation locator data logging modle and data analysis processing module.The former carries out recorded and stored to locator data.The latter calculates and assesses locator data, and the information such as dispersion of output locator data also can be analyzed with the positional information of the original analog visual hallucination point of visual hallucination emulation stimulus modality module output, and information such as positional accuracy are provided.
Using method comprises two kinds of patterns: no navigation mode and sense of touch navigation mode.
No navigation mode
In no navigation mode, the visual hallucination emulation stimulation point among the Helmet Mounted Display HMD1 directly appears in the complete black background, after the user judges the visual hallucination emulation position, can directly touch the location on touch-screen 3.
The sense of touch navigation mode
First: simple sense of touch navigation mode, as shown in Figure 1.
In simple sense of touch navigation mode, sense of touch guider 5 is positioned over touch-screen 3 the place aheads, and support 14 tops indication horizontal bar 13 points to touch screen center, and the user can place the position of horizontal bar 13 indications by a hand, and the another hand touches the location on touch-screen 3.
Second: plane touch pad pattern, as shown in Figure 2.
In plane sense of touch navigation mode, be shown as the white box on the full black background among the Helmet Mounted Display HMD1, the white edge border is corresponding with touch pad 6 outermost buttons, and touch pad 6 is fixed on the touch-screen 3.When the visual hallucination emulation luminous point occurred, the user estimated according to the relative position of luminous point and frame, and both hands assisting down of touch pad 6 senses of touch navigation, are pressed corresponding button 17 after judging on touch pad 6.Touch-screen 3 shows synchronously with Helmet Mounted Display HMD1, and writes down corresponding key position and reaction time information.
This pattern drill method is divided into two steps: 1. training; 2. official testing.
1. training
In Helmet Mounted Display HMD1, the visual hallucination emulation luminous point that at every turn occurs a white in the white edge at random, when the user pushes button after 17, error box and feedback point can appear in the touch-screen, it is the little frame of the redness at center that error box shows as with the visual hallucination emulation luminous point, feedback point is user's the relevant position of key position in Helmet Mounted Display HMD1, according to the relative position of feedback point in error box, the user can understand oneself key position and realistic simulation visual hallucination point between error.After touch-screen 3 is noted key information, analyze by computing machine 3.According to different actual needs, certain error rate can be set, when error rate was in specialized range, the user can obtain the qualification that enters official testing.
2. official testing
Be with the difference of training,, can not observe feedback point and error box at Helmet Mounted Display HMD1 when the user pushes button after 17.Can select different visual hallucination emulation stimulation protocol as required, behind the touch-screen 3 record key informations, by the accuracy of 4 pairs of visual hallucination emulation location of computing machine, discreteness, user's reaction time and various relevant information are analyzed and are assessed.
Claims (8)
1. visual hallucination emulation positioning system based on sense of touch, it is characterized in that, comprise Helmet Mounted Display, head auxiliary locator, touch-screen, computing machine, sense of touch guider and touch pad, described Helmet Mounted Display links to each other with computing machine, as the stimulus that produces visual hallucination emulation; Described head auxiliary locator is used for fixing the relative position and the angle of each user and touch-screen; Described touch-screen is used for writing down the sense of touch location of user after judging the visual hallucination position, and feeds back in the computing machine; Described sense of touch guider helps the user to determine the center of touch-screen; Described touch pad is arranged at the touch-screen top, is used for guiding auxiliary user to use visual hallucination emulation position, tactilely-perceptible location; Described computing machine produces the positional information of visual hallucination emulation point, be transferred in the Helmet Mounted Display by data line and show, the visual hallucination emulation point that the user arrives according to the observation, directly or under the sense of touch guider is auxiliary locate on touch-screen, touch-screen is sent to locating information in the computing machine by data line;
Described touch pad is made of push-button array, the guide line of substrate and distribution on it, the scope of number of keys is 4 * 4 to 100 * 100, described guide line, it distributes identical with guiding button in the push-button array, and, help the user to judge the areal distribution of push-button array fast with the guiding button.
2. the visual hallucination emulation positioning system based on sense of touch according to claim 1, it is characterized in that, described head auxiliary locator is made of pedestal, support, rack-mount chin stationary installation and forehead fixed band, the position of chin stationary installation and forehead fixed band is used for fixing the relative position and the angle of each user and touch-screen by the setting nut adjustment.
3. the visual hallucination emulation positioning system based on sense of touch according to claim 1 is characterized in that, described touch-screen range of size is 14 to 30 inches.
4. the visual hallucination emulation positioning system based on sense of touch according to claim 1, it is characterized in that, described sense of touch guider is the L type, constitute by pedestal, support and horizontal bar, pedestal center fixed one long straight bracket, this long straight bracket top is fixed with horizontal bar by setting nut, regulates horizontal bar position, top by setting nut, make its center of pointing to touch-screen, long straight bracket and horizontal bar constitute the L type structure of sense of touch guider.
5. the visual hallucination emulation positioning system based on sense of touch according to claim 1, it is characterized in that, described push-button array is positioned at the touch pad center, be used to guide the sense of touch location, constitute by common key-press, guiding button and center indication key, all buttons all can be pressed, by touch-screen record key position.
6. the visual hallucination emulation positioning system based on sense of touch according to claim 5, it is characterized in that, described center indication key is positioned at the center of push-button array, constitute by key body, spring and spring detent that the cambered surface projection is arranged, button top projection is higher than plane on the substrate, middle part key body and be located in the substrate aperture around the spring one of middle part key body, spring detent is fixed in the key body bottom of stretching out the substrate lower plane, and the center indication key exceeds push-button array plane 2mm-10mm.
7. the visual hallucination emulation positioning system based on sense of touch according to claim 5, it is characterized in that, described guiding button being distributed as in push-button array: peripheral four limits, two diagonal line, horizontal central line, median vertical lines and the length and width that are positioned at push-button array central authorities are respectively half four limits of little frame of push-button array length and width, and guiding button guiding user judges the areal distribution of push-button array fast.
8. the visual hallucination emulation positioning system based on sense of touch according to claim 1, it is characterized in that, described computing machine, wherein be provided with selectable visual hallucination emulation stimulus modality module, visual hallucination emulation locator data logging modle and data analysis processing module, the selection of stimulus modality is provided in the described visual hallucination emulation stimulus modality module, start the visual hallucination emulation position fixing process, this module is sent to the visual hallucination emulation positional information under the corresponding modes in the Helmet Mounted Display and shows, the user is according to the position of observed visual hallucination emulation point in the Helmet Mounted Display, on touch-screen, directly or under navigation is auxiliary locate, touch-screen will be located related data again and will be sent to visual hallucination emulation locator data logging modle and data analysis processing module, visual hallucination emulation locator data logging modle is carried out recorded and stored to locator data, the data analysis processing module is calculated and is assessed locator data, the dispersion information of output locator data, or be analyzed with the positional information of the original analog visual hallucination point of visual hallucination emulation stimulus modality module output, positional accuracy information is provided.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2007101707715A CN100511104C (en) | 2007-11-22 | 2007-11-22 | Visual hallucination emulation positioning system based on touch |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2007101707715A CN100511104C (en) | 2007-11-22 | 2007-11-22 | Visual hallucination emulation positioning system based on touch |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101169683A CN101169683A (en) | 2008-04-30 |
| CN100511104C true CN100511104C (en) | 2009-07-08 |
Family
ID=39390328
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2007101707715A Active CN100511104C (en) | 2007-11-22 | 2007-11-22 | Visual hallucination emulation positioning system based on touch |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100511104C (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2421602B1 (en) | 2009-03-27 | 2016-09-14 | Second Sight Medical Products | Visual prosthesis fitting system |
| KR20190077113A (en) * | 2009-07-22 | 2019-07-02 | 임머숀 코퍼레이션 | Interactive touch screen gaming metaphors with haptic feedback across platforms |
| US10186138B2 (en) * | 2014-09-02 | 2019-01-22 | Apple Inc. | Providing priming cues to a user of an electronic device |
| KR101868448B1 (en) * | 2017-02-23 | 2018-06-19 | 린츠 주식회사 | A device for providing haptic patterns on smart devices |
| TWI656359B (en) * | 2017-05-09 | 2019-04-11 | 瑞軒科技股份有限公司 | Device for mixed reality |
| CN108903919A (en) * | 2018-09-19 | 2018-11-30 | 北京理工大学 | Touch detection equipment based on volume |
| CN109782952A (en) * | 2019-01-17 | 2019-05-21 | 中国商用飞机有限责任公司北京民用飞机技术研究中心 | A kind of airborne touch screen and aircraft handling operating system |
| CN110200748A (en) * | 2019-06-03 | 2019-09-06 | 上海海洋大学 | Functional assessment simulator and its operating method under a kind of prosthetic vision |
-
2007
- 2007-11-22 CN CNB2007101707715A patent/CN100511104C/en active Active
Non-Patent Citations (4)
| Title |
|---|
| Study of Tactile Perception Based on PhosphenePositioningUsing Simulated Prosthetic Vision. Xinyu Chai,Leilei Zhang,Wenjie Li,FengShao,KunYang,Qiushi Ren.Artificial Organs,Vol.32 No.2. 2007 |
| Study of Tactile Perception Based on PhosphenePositioningUsing Simulated Prosthetic Vision. Xinyu Chai,Leilei Zhang,Wenjie Li,FengShao,KunYang,Qiushi Ren.Artificial Organs,Vol.32 No.2. 2007 * |
| Visual sensations produced by optic nerve stimulation usingan implanted self-sizing spiral cuff electrode. Claude Veraart,Christian Raftopoulos,J. ThomasMortimer,Jean Delbeke,Delphine Pins,GeraldineMichaux,Annick Vanlierde,Simone Parrini,Marie-ChantalWanet-Defalque.Brain Research. 1998 |
| Visual sensations produced by optic nerve stimulation usingan implanted self-sizing spiral cuff electrode. Claude Veraart,Christian Raftopoulos,J. ThomasMortimer,Jean Delbeke,Delphine Pins,GeraldineMichaux,Annick Vanlierde,Simone Parrini,Marie-ChantalWanet-Defalque.Brain Research. 1998 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101169683A (en) | 2008-04-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100511104C (en) | Visual hallucination emulation positioning system based on touch | |
| Wilson et al. | Perception of ultrasonic haptic feedback on the hand: localisation and apparent motion | |
| Spence et al. | Spatial constraints on visual-tactile cross-modal distractor congruency effects | |
| Alt Murphy et al. | Salgot-s troke a rm l ongitudinal study at the university of got henburg, prospective cohort study protocol | |
| CN101657143B (en) | Unitary vision and neuro-processing testing center | |
| US9952447B2 (en) | Method for determining a behavioural, postural or geometric-morphological characteristic of a person wearing spectacles | |
| CN104603673A (en) | Head mounted system and method to compute and render stream of digital images using head mounted system | |
| Le Seac’h et al. | Multimodal reference frame for the planning of vertical arms movements | |
| US9671617B2 (en) | Method for estimating a distance separating a pair of glasses and an eye of the wearer of the pair of glasses | |
| Riley et al. | Inertial constraints on limb proprioception are independent of visual calibration. | |
| KR20100015550A (en) | Unitary vision and neuro-processing testing center | |
| CN107224273B (en) | Central-peripheral nerve closed-loop rehabilitation training method and system based on optical brain imaging nerve feedback | |
| CN201929941U (en) | Hemispheric stimulating vision function diagnosis and treatment instrument | |
| Lee et al. | Funneling and saltation effects for tactile interaction with virtual objects | |
| CN105853162A (en) | Multi-mode vision improvement training system and training method thereof | |
| CN112315754B (en) | Vision training system based on VR glasses and VR glasses | |
| ES2659056T3 (en) | Didactic method and system to modify the postural behavior of a furniture user | |
| CN104750241B (en) | Head-mounted device and related simulation system and simulation method thereof | |
| JPWO2009151121A1 (en) | Sensory presentation system and sensory presentation device | |
| US20170113095A1 (en) | Device and method for restoring and developing hand functions | |
| CN204636922U (en) | Comprehensive therapeutical instrument for amblyopia | |
| CN102008286A (en) | Hemispherical projection-based vision function diagnosing and treating system | |
| CN108348152B (en) | Method for determining a visual behavior parameter of an individual and related testing device | |
| Thøgersen et al. | Removing own-limb visual input using mixed reality (MR) produces a “telescoping” illusion in healthy individuals | |
| CN110721431A (en) | Sensory integration detuning testing and training device and system based on visual and auditory pathways |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| ASS | Succession or assignment of patent right |
Owner name: SHANGHAI HUASHI INVESTMENT CO., LTD. Free format text: FORMER OWNER: SHANGHAI JIAO TONG UNIVERSITY Effective date: 20101217 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| COR | Change of bibliographic data |
Free format text: CORRECT: ADDRESS; FROM: 200240 NO. 800, DONGCHUAN ROAD, MINHANG DISTRICT, SHANGHAI TO: 200040 5D, HUATONG BUILDING, NO. 618, XIKANG ROAD, JING'AN DISTRICT, SHANGHAI |
|
| TR01 | Transfer of patent right |
Effective date of registration: 20101217 Address after: Xikang Road 200040 Shanghai City No. 618 Jingan District Huatong building 5D Patentee after: Shanghai Huashi Investment Co.,Ltd. Address before: 200240 Dongchuan Road, Shanghai, No. 800, No. Patentee before: Shanghai Jiao Tong University |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240109 Address after: Room 1260, South Building of Film and Television Park, No. 4915 Beisong Road, Songjiang District, Shanghai, 200000 Patentee after: SHANGHAI KANGAO MEDICAL TECHNOLOGY Co.,Ltd. Address before: 5D, Huatong Building, No. 618 Xikang Road, Jing'an District, Shanghai 200040 Patentee before: Shanghai Huashi Investment Co.,Ltd. |