KR101710448B1 - Apparatus for providing audiovisual information using electrical stimulus - Google Patents
Apparatus for providing audiovisual information using electrical stimulus Download PDFInfo
- Publication number
- KR101710448B1 KR101710448B1 KR1020160025058A KR20160025058A KR101710448B1 KR 101710448 B1 KR101710448 B1 KR 101710448B1 KR 1020160025058 A KR1020160025058 A KR 1020160025058A KR 20160025058 A KR20160025058 A KR 20160025058A KR 101710448 B1 KR101710448 B1 KR 101710448B1
- Authority
- KR
- South Korea
- Prior art keywords
- electrode
- signal
- electrode pad
- information
- control table
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
- H04R5/033—Headphones for stereophonic communication
- H04R5/0335—Earpiece support, e.g. headbands or neckrests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
- H04R2460/13—Hearing devices using bone conduction transducers
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
An apparatus for providing audiovisual information through electrical stimulation according to an embodiment of the present invention includes: an electrode pad attached to a user's body and having a matrix-shaped electrode array structure; A sensor sensing unit that acquires three-dimensional stereoscopic information about a shape and a distance of an object around the sensor using a sensor; And a controller for selectively applying an electric signal to each of the electrode arrays of the electrode pad based on the three-dimensional stereoscopic information to provide an electric stimulus for recognizing the peripheral object to the user through an output signal of the electrode pad .
Description
Embodiments of the present invention relate to an apparatus for providing audiovisual information through electrical stimulation.
Human skin is sensitive compared to other body organs, so it has a characteristic of reacting immediately.
Accordingly, the senses of the skin can be utilized as a third visual or auditory information sensing body, and information about nearby objects can be converted into electrical signals and transmitted to the skin.
However, when the skin is used as a sensing body for audiovisual information as described above, only general methods such as simply applying electrical stimulation or generating an acoustic warning have been used.
Therefore, in order to transmit information of an object to a person's skin in real time, development of a technique of applying electrical stimulation to the skin step by step, reflecting the information of the object, that is, passing electric signals different from each other through electric stimulation points attached to the skin .
Related prior arts are Korean Patent Publication No. 10-2008-0027378 (titled " Measurement and stimulation of muscle tissue, public date: March 26, 2008).
In an embodiment of the present invention, an electric signal for three-dimensional information (stereoscopic information and sound information) obtained from an object is selectively applied to an electrode pad attached to a user's body so that the user can recognize three- And provides an audiovisual information providing apparatus through electrical stimulation.
The problems to be solved by the present invention are not limited to the above-mentioned problem (s), and another problem (s) not mentioned can be clearly understood by those skilled in the art from the following description.
An apparatus for providing audiovisual information through electrical stimulation according to an embodiment of the present invention includes: an electrode pad attached to a user's body and having a matrix-shaped electrode array structure; A sensor sensing unit that acquires three-dimensional stereoscopic information about a shape and a distance of an object around the sensor using a sensor; And a controller for selectively applying an electric signal to each of the electrode arrays of the electrode pad based on the three-dimensional stereoscopic information to provide an electric stimulus for recognizing the peripheral object to the user through an output signal of the electrode pad .
The apparatus for providing audiovisual information through electrical stimulation according to an embodiment of the present invention includes a data storage unit for storing signal data corresponding to object shape and distance in a control table corresponding to each electrode position based on the matrix form of the electrode pad, ; And a data processing unit for extracting signal data corresponding to the three-dimensional solid-state information from the control table, wherein the signal applying unit refers to the control table and outputs an electric signal corresponding to the extracted signal data to the electrode pad To the respective electrode positions of the electrodes.
The data storage unit may store the signal data in the control table so as to have intensity and frequency of different voltages according to the shape and distance of the object.
The signal application unit may include a controller for controlling the magnitude and frequency of the voltage with respect to the electric signal when the electric signal is applied to each of the electrode arrays of the electrode pad.
Wherein the signal applying unit extracts a matrix value corresponding to the extracted signal data by referring to the control table and outputs at least one of the array electrodes in the electrode pad based on the extracted matrix value And a selection unit for selecting the electrode.
Wherein the electrode pad has an electrode array structure in which at least two or more electrodes are arranged in a row and a column, and the signal application unit has a structure in which, when the electrode pad has an electrode array structure in which four electrodes are arranged, Wherein the first and second circuits are connected to the first and second electrodes, respectively, and the current intensities flowing through the first and second circuits are controlled so that the intensity of the current flowing through the second circuit is within a certain range The electric signal can be applied to each of the electrode arrays of the electrode pad.
The sensor sensing unit may acquire the three-dimensional stereoscopic image using at least one of a depth sensor and an array camera.
The sensor sensing unit senses the sound of the surrounding object to acquire sound information about the intensity and direction of the sound, and the signal applying unit selectively applies an electric signal to each of the electrode arrays of the electrode pad based on the sound information. can do.
The apparatus for providing audiovisual information through electrical stimulation according to an embodiment of the present invention includes a data storage unit for storing signal data corresponding to the intensity and direction of sound in a control table corresponding to each electrode position based on the matrix form of the electrode pad, ; And a data processing unit for extracting signal data corresponding to the sound information from the control table, wherein the signal applying unit refers to the control table and outputs an electric signal corresponding to the extracted signal data to a corresponding It can be selectively applied to each of the electrode positions.
The details of other embodiments are included in the detailed description and the accompanying drawings.
According to an embodiment of the present invention, an electric signal for three-dimensional information (stereoscopic information and sound information) obtained from an object is selectively applied to an electrode pad attached to a user's body so that a user can obtain three- .
According to an embodiment of the present invention, three-dimensional information (stereoscopic information and sound information) obtained from an object can be displayed to a user by varying the magnitude of the voltage and the magnitude of the frequency according to the shape of the object, By providing electrical stimulation, a user can more intuitively recognize the stereoscopic state of an object.
According to the embodiment of the present invention, it is possible to transmit the three-dimensional configuration information of the object and its change to the skin of the user in real time by converting the audiovisual information analyzed into the three-dimensional space into the electric stimulus, It is possible to grasp the shape information and /
1 is a view for explaining an operation of an audiovisual information providing apparatus through electrical stimulation according to an embodiment of the present invention.
FIG. 2 is a view showing an embodiment of three-dimensional stereoscopic information on an electrode pad according to an embodiment of the present invention.
3 is a block diagram illustrating an apparatus for providing audiovisual information through electrical stimulation according to an embodiment of the present invention.
4 and 5 are diagrams for explaining an electrode pad having an array structure in which two electrodes are arranged in an embodiment of the present invention.
FIG. 6 is a view for explaining an interference phenomenon occurring through each electrode when an electrode pad having an array structure in which four electrodes are arranged, according to an embodiment of the present invention. FIG.
FIG. 7 is a view for explaining a scanning effect in the case of using an electrode pad having an array structure in which four electrodes are arranged.
BRIEF DESCRIPTION OF THE DRAWINGS The advantages and / or features of the present invention, and how to accomplish them, will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. It should be understood, however, that the invention is not limited to the disclosed embodiments, but is capable of many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
FIG. 1 is a view for explaining the operation of an apparatus for providing audiovisual information through electrical stimulation according to an embodiment of the present invention. FIG. 2 is a diagram for explaining the operation of the apparatus for providing three- And FIG.
1 and 2, an apparatus for providing audiovisual information through electrical stimulation according to an exemplary embodiment of the present invention may include an image sensor, such as an array camera or a depth sensor, Three-dimensional stereoscopic information can be obtained. That is, the audiovisual information providing apparatus recognizes the surrounding objects with the image recognition sensor and can grasp the three-dimensional stereoscopic shape of the object or the three-dimensional stereoscopic information related to the distance to the object.
In addition, the audiovisual information providing apparatus can acquire three-dimensional acoustic information on the surrounding objects using an acoustic recognition sensor such as a mic array. That is, the audiovisual information providing device can recognize the sound of the surrounding objects with the acoustic recognition sensor, and can grasp the three-dimensional acoustic information related to the intensity and direction of the sound.
Thereafter, the audiovisual information providing apparatus can perform signal processing for converting the three-dimensional information (three-dimensional stereo information and three-dimensional sound information) obtained from the surrounding objects into a two-dimensional electric signal .
At this time, the converted electrical signal may be transmitted to the electrode pad attached to the user's body.
In other words, the audiovisual information providing apparatus applies the converted electric signal to each electrode of the electrode pad on which a plurality of electrodes are arranged, so that the user recognizes the three-dimensional information by feeling electric stimulation from the electrode pad can do.
The configuration and function of the audiovisual information providing apparatus will be described in more detail with reference to FIG.
3 is a block diagram illustrating an apparatus for providing audiovisual information through electrical stimulation according to an embodiment of the present invention.
3, the audiovisual
The
That is, the
At this time, the
The
The
The
For this, the
The electrode array structure of the
The
For this, the
The
That is, in the control table, signal data reflecting the shape and distance of the peripheral object may be stored for each electrode of the
For example, it is assumed that the
Alternatively, the
The
In other words, the
Alternatively, the
That is, the
Accordingly, the
Here, the
That is, the
Meanwhile, the
That is, the signal data corresponds to the shape and the distance of the object, and the magnitude and the frequency of the voltage are different for each electrode position and can be stored in the control table.
Here, when the electric signal is applied to each of the electrode arrays of the
For example, when the
4 and 5 are diagrams for explaining an electrode pad having an array structure in which two electrodes are arranged in an embodiment of the present invention.
Referring to FIG. 4, the
That is, the
The
According to an embodiment of the present invention, a simple circuit can be constructed. By attaching the
5, the
In this case, the
According to an embodiment of the present invention, a complicated circuit can be constructed. By attaching the
6 is a view for explaining an interference phenomenon occurring through each electrode when an electrode pad having an array structure in which four electrodes are arranged is used in an embodiment of the present invention, FIG. 3 is a diagram illustrating a scanning effect in the case of using an electrode pad having an array structure in which four electrodes are arranged. FIG.
6, two different types of electrodes are connected to the
At this time, it is possible to energize two unmodulated alternating currents in the first and second circuits (Circuit1 and Circuit2), respectively, and the two alternating currents may cross each other in the circuit to cause an interference phenomenon.
Here, the modulation depth modulated by crossing the two alternating currents varies depending on the direction of the current, and may vary from 0% to 100% at the minimum.
6, when the amplitudes of the same magnitude are energized at 90 degrees in the first and second circuits (Circuit1 and Circuit2), the maximum amplitude is at 45 degrees which is an intermediate point between the two circuits Lt; / RTI >
7, when the
That is, the intensity of the current flowing through the second circuit (Circuit 2) is fixed and the intensity of the current flowing through the first circuit (Circuit 1) can be changed within a certain range.
For example, the intensity of the current flowing in the second circuit (Circuit2) is automatically adjusted to 75% of the maximum current intensity, and the intensity of the current flowing in the first circuit (Circuit1) varies within the range of 50 to 100% Lt; / RTI >
When the user applies electric stimulation to the user with the interference current generated by the static interference pattern through the scanning effect of the
While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the scope of the appended claims and equivalents thereof.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, Modification is possible. Accordingly, the spirit of the present invention should be understood only in accordance with the following claims, and all equivalents or equivalent variations thereof are included in the scope of the present invention.
310:
320: Electrode pad
330:
332:
334:
340: Data storage unit
350:
410, 510: first electrode
420, 520: second electrode
Claims (9)
A sensor sensing unit for acquiring three-dimensional stereoscopic information about a shape and a distance of a surrounding object using a sensor; And
And a signal applying unit for applying an electric signal to each of the electrode arrays of the electrode pad based on the three-dimensional stereoscopic information to provide an electric stimulus for recognizing the peripheral object to the user through an output signal of the electrode pad,
Lt; / RTI >
The signal application unit
And first and second circuits respectively connected to different electrodes included in the electrode pad,
Wherein the AC current generated from the first circuit and the AC current generated from the second circuit are cross-energized at a stimulation site to cause an interference phenomenon.
A data storage unit for storing signal data corresponding to object shape and distance in a control table corresponding to each electrode position based on a matrix form of the electrode pad; And
And a data processing unit for extracting signal data corresponding to the three-
Further comprising:
The signal application unit
And an electric signal corresponding to the extracted signal data is selectively applied to corresponding electrode positions of the electrode pad with reference to the control table.
The data storage unit
Wherein the signal data is stored in the control table so that the signal data has intensity and frequency of different voltages according to the shape and distance of the object.
The signal application unit
And a controller for controlling the magnitude of the voltage and frequency of the electric signal when the electric signal is applied to each of the electrode arrays of the electrode pads.
The signal application unit
Extracting a matrix value corresponding to the extracted signal data with reference to the control table and selecting at least one electrode among the array electrodes within the electrode pad to apply the electrical signal based on the extracted matrix value Selection unit
Wherein the audiovisual information providing apparatus comprises:
The electrode pad
At least two or more electrodes are arranged in rows and columns,
The signal application unit
Wherein the first and second circuits are connected to two different ones of the four electrodes when the electrode pad has an electrode array structure in which four electrodes are arranged, Wherein the electric signal is applied to each of the electrode arrays of the electrode pad by changing the intensity of the electric current flowing through the first circuit and the electric current flowing through the second circuit within a predetermined range by controlling the electrical stimulation A device for providing audiovisual information through the device.
The sensor sensing unit
Dimensional stereoscopic image using at least one of a depth sensor, an array camera, and an array camera.
The sensor sensing unit
Detecting sound of the surrounding object to acquire acoustic information about intensity and direction of the sound,
The signal application unit
And an electric signal is selectively applied to each of the electrode arrays of the electrode pads based on the acoustic information.
A data storage unit for storing signal data corresponding to the intensity and direction of sound in a control table correspondingly to each electrode position based on the matrix form of the electrode pad; And
A data processor for extracting signal data corresponding to the sound information from the control table,
Further comprising:
The signal application unit
And an electric signal corresponding to the extracted signal data is selectively applied to corresponding electrode positions of the electrode pad with reference to the control table.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160025058A KR101710448B1 (en) | 2016-03-02 | 2016-03-02 | Apparatus for providing audiovisual information using electrical stimulus |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160025058A KR101710448B1 (en) | 2016-03-02 | 2016-03-02 | Apparatus for providing audiovisual information using electrical stimulus |
Publications (1)
Publication Number | Publication Date |
---|---|
KR101710448B1 true KR101710448B1 (en) | 2017-02-27 |
Family
ID=58315589
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020160025058A KR101710448B1 (en) | 2016-03-02 | 2016-03-02 | Apparatus for providing audiovisual information using electrical stimulus |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101710448B1 (en) |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20110111563A (en) * | 2010-04-05 | 2011-10-12 | 김의겸 | The forehead sensory recognition system for a blind person |
-
2016
- 2016-03-02 KR KR1020160025058A patent/KR101710448B1/en active IP Right Grant
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20110111563A (en) * | 2010-04-05 | 2011-10-12 | 김의겸 | The forehead sensory recognition system for a blind person |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Hoang et al. | Obstacle detection and warning system for visually impaired people based on electrode matrix and mobile Kinect | |
KR102278456B1 (en) | Tactile information conversion apparatus, tactile information conversion method, tactile information conversion program, and element arrangement structure | |
JP4360497B2 (en) | Electric tactile presentation device and electric tactile presentation method | |
US20070016425A1 (en) | Device for providing perception of the physical environment | |
JPWO2017175867A1 (en) | Tactile information conversion device, tactile information conversion method, and tactile information conversion program | |
US8920174B2 (en) | Electric tactile display | |
US20170087023A1 (en) | Active Confocal Imaging Systems and Methods for Visual Prostheses | |
KR101841625B1 (en) | Apparatus for replacing sense based on brain stimulation, and method thereof and computer-readable recording media using the same | |
US10843299B2 (en) | Object recognition and presentation for the visually impaired | |
KR20160033969A (en) | Terminal apparatus and controlling method thereof | |
Peruzzini et al. | Electro-tactile device for texture simulation | |
JP2022500198A (en) | Nerve prosthesis systems and methods for surrogate mammalian sensory modality by high-density electrical stimulation of areas of the cerebral cortex | |
JP2007268034A (en) | Method and device for measuring biological signal | |
Hoang et al. | Obstacle detection and warning for visually impaired people based on electrode matrix and mobile Kinect | |
KR101710448B1 (en) | Apparatus for providing audiovisual information using electrical stimulus | |
Hartcher-O'Brien et al. | Perception of distance-to-obstacle through time-delayed tactile feedback | |
EP3459442A1 (en) | Method and system for supporting a medical brain mapping procedure | |
JP2018143353A (en) | Guiding device for biomedical electrode | |
KR102001022B1 (en) | Apparatus for providing information using electrode pad having variable structure | |
US20200187826A1 (en) | Ultrasound imaging system and interventional medical device for use therewith | |
KR20120004709A (en) | Tactile stimulator system for and method therefor | |
Dakopoulos et al. | Towards a 2D tactile vocabulary for navigation of blind and visually impaired | |
US20150082244A1 (en) | Character input device using event-related potential and control method thereof | |
Yoon et al. | Psychophysical experiment of vibrotactile pattern perception by human fingertip | |
US20190065854A1 (en) | System and method for visio-tactile sensing |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
GRNT | Written decision to grant |