CA2169198A1 - Tactile computer display for the blind - Google Patents

Tactile computer display for the blind

Info

Publication number
CA2169198A1
CA2169198A1 CA002169198A CA2169198A CA2169198A1 CA 2169198 A1 CA2169198 A1 CA 2169198A1 CA 002169198 A CA002169198 A CA 002169198A CA 2169198 A CA2169198 A CA 2169198A CA 2169198 A1 CA2169198 A1 CA 2169198A1
Authority
CA
Canada
Prior art keywords
display
pixel
elastic membrane
blind
substance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA002169198A
Other languages
French (fr)
Inventor
Marc Tremblay
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CA002169198A priority Critical patent/CA2169198A1/en
Publication of CA2169198A1 publication Critical patent/CA2169198A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001Teaching or communicating with blind persons
    • G09B21/003Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001Teaching or communicating with blind persons
    • G09B21/003Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays
    • G09B21/004Details of particular tactile cells, e.g. electro-mechanical or mechanical layout

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)

Abstract

This invention discloses a tactile display for computer to be used by blind people with finger reading skills. The display is made of a plurality of independently inflatable dots called pixel, arranged in a dense matrix format. The matrix can display many lines of Brail characters or graphics. The control of each pixel relies on the expansion of a substance heated by an electric element. Each pixel is made of a small cylinder containing the expansion substance. The cylinders are closed up rigidly at the bottom end and by an elastic membrane at the top end. The elastic membrane serves as the reading surface. To raise a pixel, the corresponding electronic drivers are turned on to activate the pixel's heater. As the substance contained in the cylinder heats up, it expands to stretch the section of the elastic membrane covering it. The membrane then forms a bump of sufficient height to be sensed by the reader's finger. As soon as the drivers deactivate the pixel's heater, the substance cools down and shrinks. The elastic membrane is then pulled down making the surface flat again. During normal operation, the drivers are successively activated in order to scan the whole surface of the display activating only the pixels that should be raised. This technology is not only limited to be used by the blind but can also produce tactile feedback devices for virtual reality applications or to make various massaging devices.

Description

FIELD OF THE INVENTION
The invention presented relates to a tactile computer display for the blind, and more particularly to a large area of high pixel density arranged in a two-dimensional array having a full screen capability.
The vertical movement of the pixels is the result of the thermal expansion of a substance contained in a plurality of cylinder closed up by an elastic membrane at the top end. This screen can display both Brail characters and graphics.

BACKGROUND OF THE INVENTION
Much work has been devoted to produce a tactile computer display which could represent the text and graphics available to people with normal vision. Some Brail displays are being produced but their mechanical complexity and their cost limit them to one or two lines of text. Canadian Pat. No. 2,109,863 is an example of the mechanical devices. This limitation makes them difficult to use with modern graphics based computer programs and prevents the use of a tracking device, such as a mouse. Some full screen tactile displays based on mechanical or electrorheological principles have been patented refer to US Pat. No 4,836,784 or 5,222,895. They seem to be either too slow or too complicated to be cost effective and as far as we know were not commercialised.

SUMMARY OF THE INVENTION
It is the main purpose of the present invention to create a full screen tactile display using the thermal expansion of a substance contained in a plurality of small isolated cylinders closed up rigidly at the bottom end with a thermally conductive plug and with an elastic membrane at the top end. The elastic membrane becomes the reading surface of the display. Each cylinder contains an individually controllable heating element to produce the expansion of the substance while its cooling is done through the thermally conductive bottom.

In one of the realisations of a full screen tactile display, thousands of pixels are placed side by side in a two dimensional 128 by 128 matrix. The substance in the pixels needs a high thermal expansion coefficient and should be safe to use. This particular realisation of the invention uses a fabrication process based on printed circuit board technology to produce the dense matrix of individually controllable pixels at a reasonable cost. The heater resistance of approximately 300 ohms and a short power pulse in the range of 1 Watt at 15 Volts is necessary to raise a pixel. This low potential and the use of an inert expansion substance like paraffin makes it safe for the operator even in case of failure of the display.

In the preferred version of the invention the tactile reading surface is made of four identical sections placed in a two by two matrix arrangement. This configuration simplifies both the production ~ CA21 691 98 and the testing while increasing the yield and the refreshing rate.
Each section becomes a 64 by 64 matrix easily controllable by standard electronic drivers.

This full screen tactile display with graphics capability coupled with a touch screen circuit permits the blind to operate almost any standard computer program as well as a seeing person. A short program to convert standard characters into Brail ones, and to bring the graphics resolution to a manageable level is used but not covered in this invention. Once the blind person can interact efficiently with the computer, a video camera and other sensors can be added to the system. With a certain amount of processing, the images could be placed on the display allowing the blind to "see" the environment.
With a portable system, the blind person could walk around without a white cane and identify the outline of the environment, read both the civic numbers and the streets name, and possibly enjoy a visit to the museum.

`-- CA216ql98 DESCRIPTION OF THE DRAWINGS
The following paragraphs relate to the figures included in this document. Figure 1 shows the tactile display with its finger reading area while figure 2 shows its cross-section. The operation of the reading surface is demonstrated in figure 3 where the two activated pixel contrast with the two at rest. This figure shows the reader's finger approximately to scale. Finally figure 4 is a simplified electrical schematic of an array where an example of the row drivers activating two pixel from the same column is given. This mode of activation improve the speed of response of the display.

Figure 1 shows the tactile display with its finger reading area (10), the enclosure (12), and various function keys (13). The function keys are laid out around the perimeter to make them easy to access. Their function is written on them in brail. The blank area (11) around the reading area (10) is left to help the reader to reach the limits of the text.

Figure 2 shows a simplified cross-section of the display. It is made of a reading board (10) holding an array of up to sixteen thousand pixel. The electronic drivers for the pixel are mounted on the printed circuit board below (31). Connectors (32) are used to link the two boards electrically. Air is forced by one or more fan(s) (33) to cool the base of the reading board (10). An enclosure (12) protects the electronic components.

CA~169198 Figure 3 shows a cross-section of the reading surface. The operation of each pixel relies on the expansion of a heated substance (21) . In the illustration the two left pixel are at rest while the two others are activated, stretching the elastic membrane into a small bump. The finger of a reader (25) has been drawn to illustrate the dimension of the pixel. Each pixel is in fact a cylinder (23) which is rigidly closed at one end (26) and covered by an elastic membrane (22) at the other. The membrane (22) is glued to the body (29) of the reading surface. The wall of the cylinder is covered by a resistive material (28) which serves as the electric heater.

One of the fabrication processes used relies on printed circuit board technology. The body (29) of the reading surface is produced by laminating three layers of printed circuit containing a plurality of holes which form the pixel's cylinders (23) . The two external layers hold the conducting traces and electrodes (27) used by the drivers to activate the pixel. The thermally conductive plugs (26) of the bottom layer are produced by soldering the plurality of plated through holes it contains before laminating it to the other layers.
The heaters (28) are made by depositing and curing a controlled amount of resistive material in each cylinder (23) . The diodes (40) are then mounted to the bottom board. The next production steps consist in filling the cylinders (23) with the expansion substance (21) and sealing the top of the reading surface with the elastic membrane (22) .
Thorough testing is performed at each production step to insure a high yield.

To raise a pixel, power is applied to its electrodes (27). The substance (21) heats up and expands while melting. Since the cylinder is rigid, the increase in volume stretches the elastic membrane (22) up. This forms a bump which can be sensed by the reader's finger.

To retract the pixel, the power is removed. The heat is evacuated through the bottom of the board by the thermally conductive base (26).
The volume of the substance decreases and the elastic membrane returns to its flat position.

The speed at which the pixel can raise or lower depends on how fast the temperature of the substance can be changed, and which substance is used. Paraffin and wax are some of the substances known to give satisfactory results. To create a temperature regulating effect for each pixel, the heater's material contains thermistor ceramics. This material has an electrical resistance which increases sharply once a certain temperature has been reached. This releases the electronic control from having to limit the power to the pixel when approaching the maximum temperature.

Figure 4 is the simplified electrical schematic of an array. The resistors (41) represent the pixel's heater. Each pixel must be driven through a small diode (40). The diode prevents conduction when the pixel is not selected by the drivers. In the example given, the rows driver (42) supplies a positive potential to the rows 1 and 4 containing the pixel to be raised. The columns driver (43) pulls its ~ C`A~ r~ !98 output number 2 to zero volts to bias only this one column. After a few thousandths of a second, the next column is selected with new row drivers activated. The whole board is scanned a few times per second so it appears continuous. The reaction time of the pixel being longer than the scan time, its expansion is smooth and continuous.

While many aspects of the principles of operation, the production techniques, and the material used have been shown and described, further implementation or combinations of those described herein will be apparent to those with knowledge in the field without departing from the spirit of the invention.

Claims (9)

1- A tactile computer display for the blind, comprising tactile elements called pixel, in sufficient number and on a sufficiently large area to easily display both graphics and brail text; the said pixel driven by the thermal expansion of a substance confined into cylinders closed rigidly at the bottom with a thermally conductive plug and with an elastic membrane at the top; the said pixel made by producing contiguous holes into several laminated layers of non conductive rigid material supporting a network of conductive traces serving as electrodes arranged in a row column fashion; the said pixel containing a heating element and a diode connected to some electronic drivers by the said electrodes.
2- The display of claim 1, wherein the said elastic membrane glued to the top of the display is used as the reading surface.
3- The display of claim 1, wherein the said substance used in each of the said pixel is either paraffin or wax both having a very high thermal expansion coefficient.
4- The display of claim 1, wherein the said heaters increase their electrical resistance once the maximum operating temperature is reached making them self-regulated.
5- The display of claim 1, wherein the said electronic drivers can activate simultaneously many pixel located in the same column.
6- A usage of the display of claim 1, wherein the said display is used to provide navigational and environmental information to the blind; the said information coming from different sensors such as; a camera, and/or a GPS receiver, and/or diverse sensors all coupled to a portable computer converting the said information into a suitable graphical and textual format to be placed on the said display and read by the blind while progressing in his environment.
7- The usage of claim 6, wherein the said display equipped with a suitable harness is worn vertically on the hip with the said reading surface facing away allowing the blind to freely scan it with his fingers and control the said computer to modify the presentation of the said information.
8- A tactile stimulation device used in virtual reality or massaging applications, comprising tactile elements in sufficient number and on a sufficiently large area to cover a section of the human body; the said elements driven by the thermal expansion of a substance confined into cylinders closed rigidly at the bottom with a thermally conductive plug and with an elastic membrane at the top; the said elements made by producing contiguous holes into several laminated layers of non conductive rigid material shaped for the specific application and supporting a network of conductive traces serving as electrodes arranged in a row column fashion; the said elements containing an electrical heater and a diode connected to some electronic drivers by the said electrodes.
9- The tactile stimulation device of claim 8, wherein the said laminated layers of the non conductive material are made flexible.
CA002169198A 1996-02-09 1996-02-09 Tactile computer display for the blind Abandoned CA2169198A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CA002169198A CA2169198A1 (en) 1996-02-09 1996-02-09 Tactile computer display for the blind

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CA002169198A CA2169198A1 (en) 1996-02-09 1996-02-09 Tactile computer display for the blind

Publications (1)

Publication Number Publication Date
CA2169198A1 true CA2169198A1 (en) 1997-08-10

Family

ID=4157540

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002169198A Abandoned CA2169198A1 (en) 1996-02-09 1996-02-09 Tactile computer display for the blind

Country Status (1)

Country Link
CA (1) CA2169198A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2204273A1 (en) * 2002-02-21 2004-04-16 Universidad De Malaga Refreshable tactile display for providing graphics display, has set of actuators and sealed chamber with flexible wall, and heating element is provided to increase temperature of vapor pressure in chamber
US20120050172A1 (en) * 2010-08-26 2012-03-01 Sony Corporation Method and system for tactile display
CN102779445A (en) * 2011-05-10 2012-11-14 中国科学院理化技术研究所 Braille reading and writing device based on cold and hot signals
CN106601082A (en) * 2016-12-30 2017-04-26 浙江八瓦文化创意发展有限公司 Braille finger ring
CN106683532A (en) * 2016-12-30 2017-05-17 浙江八瓦文化创意发展有限公司 Blind person reading ring
CN106846989A (en) * 2016-12-30 2017-06-13 浙江八瓦文化创意发展有限公司 A kind of braille reader
CN107067890A (en) * 2016-12-30 2017-08-18 浙江八瓦文化创意发展有限公司 A kind of reading aid for blindmen
CN107067891A (en) * 2016-12-30 2017-08-18 浙江八瓦文化创意发展有限公司 A kind of braille notebook reader
CN107967079A (en) * 2016-10-19 2018-04-27 现代自动车株式会社 Touch input device and its control method

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2204273A1 (en) * 2002-02-21 2004-04-16 Universidad De Malaga Refreshable tactile display for providing graphics display, has set of actuators and sealed chamber with flexible wall, and heating element is provided to increase temperature of vapor pressure in chamber
US20120050172A1 (en) * 2010-08-26 2012-03-01 Sony Corporation Method and system for tactile display
US8411058B2 (en) * 2010-08-26 2013-04-02 Sony Corporation Method and system for tactile display
CN102779445A (en) * 2011-05-10 2012-11-14 中国科学院理化技术研究所 Braille reading and writing device based on cold and hot signals
CN107967079A (en) * 2016-10-19 2018-04-27 现代自动车株式会社 Touch input device and its control method
CN106601082A (en) * 2016-12-30 2017-04-26 浙江八瓦文化创意发展有限公司 Braille finger ring
CN106683532A (en) * 2016-12-30 2017-05-17 浙江八瓦文化创意发展有限公司 Blind person reading ring
CN106846989A (en) * 2016-12-30 2017-06-13 浙江八瓦文化创意发展有限公司 A kind of braille reader
CN107067890A (en) * 2016-12-30 2017-08-18 浙江八瓦文化创意发展有限公司 A kind of reading aid for blindmen
CN107067891A (en) * 2016-12-30 2017-08-18 浙江八瓦文化创意发展有限公司 A kind of braille notebook reader

Similar Documents

Publication Publication Date Title
US4414984A (en) Methods and apparatus for recording and or reproducing tactile sensations
TWI710934B (en) Tactile information conversion device, tactile information conversion method, tactile information conversion program and component arrangement structure
US10338682B2 (en) Method and apparatus for providing multi-point haptic feedback texture systems
US20050069842A1 (en) Apparatus and methods for a shape memory spring actuator and display
EP2176734B1 (en) Method and apparatus for multi-touch tactile touch panel actuator mechanisms
US6462840B1 (en) Three dimensional monitor and tactile scanner
KR20130049174A (en) Display elements
CA2169198A1 (en) Tactile computer display for the blind
CN103608749A (en) Systems and devices for recording and reproducing senses
US11630526B2 (en) Input system and input method
US10437340B1 (en) Device for providing thermoreceptive haptic feedback
EP3425482A2 (en) Active matrix haptic feedback
JP2005150146A (en) Flexible detector
Kajimoto et al. Wearable tactile display based on thermal expansion of nichrome wire
KR102422974B1 (en) Apparatus for controlling hybrid display for providing texture and temperature at the same time and method using the same
Kim et al. Two-dimensional thermal haptic module based on a flexible thermoelectric device
EP1013144A2 (en) Apparatus and methods for a shape memory spring actuator and display
Runyan et al. The continuing quest for the'Holy Braille'of tactile displays
US5576553A (en) Two dimensional thermal image generator
Khoudja et al. Vital: a vibrotactile interface with thermal feedback
CN209803736U (en) tactile feedback structure, tactile feedback system and wearable device
CN113703187A (en) Display device and display method
US20230305628A1 (en) Bilateral vibrotactile actuator
JP2000112536A (en) Heat information outputting device and heat control element arranging method
Sawada et al. Tactile pad for the presentation of tactile sensation from moving pictures

Legal Events

Date Code Title Description
EEER Examination request
FZDE Discontinued