CN107678595B - Braille recognition device, terminal device, and Braille recognition method - Google Patents
Braille recognition device, terminal device, and Braille recognition method Download PDFInfo
- Publication number
- CN107678595B CN107678595B CN201710938858.6A CN201710938858A CN107678595B CN 107678595 B CN107678595 B CN 107678595B CN 201710938858 A CN201710938858 A CN 201710938858A CN 107678595 B CN107678595 B CN 107678595B
- Authority
- CN
- China
- Prior art keywords
- braille
- pattern
- characters
- pressure sensor
- carrier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0414—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04104—Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04802—3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Telephone Function (AREA)
- Character Input (AREA)
Abstract
The invention discloses a Braille recognition device, terminal equipment and a Braille recognition method, wherein the Braille recognition device comprises a pressure sensor and a pattern recognition module. The pressure sensor is used for collecting patterns formed by pressure contacts formed on the pressure sensor by the Braille carrier. The pattern recognition module is used for recognizing the pattern as braille. By adopting the Braille identification device, the terminal equipment and the Braille identification method, interactive equipment such as an intelligent terminal and the like can identify Braille, so that special groups can use the equipment conveniently.
Description
Technical Field
The invention belongs to the field of pressure sensing, and particularly relates to a Braille recognition device, terminal equipment and a Braille recognition method.
Background
At present, touch screens are widely used in the fields of intelligent terminals and human-computer interaction. Taking 3D Touch technology (a stereoscopic Touch technology) as an example, the technology is already applied in many manufacturers, but the technology is only applied to a human-computer interaction interface of a mobile terminal at present, for example, an operation of entering a secondary menu.
With the popularization of mobile terminals, more and more users including special groups come into contact with and use the mobile terminals. However, equipment such as an intelligent terminal and the like cannot identify braille at present and receive braille input instructions, and special groups have difficulty in using the equipment.
Disclosure of Invention
The invention aims to solve the technical problem that equipment such as an intelligent terminal and the like with a touch screen cannot identify braille in the prior art, and provides a braille identification device, terminal equipment and a braille identification method.
The invention solves the technical problems through the following technical scheme: a Braille identification device comprises a pressure sensor and a pattern identification module;
the pressure sensor is used for collecting patterns formed by pressure contacts formed on the pressure sensor by the Braille carrier;
the pattern recognition module is used for recognizing the patterns as braille characters.
Optionally, the pattern recognition module is configured to adjust the pattern to a standard direction according to an arrangement direction of the dots in the pattern.
Optionally, the pattern recognition module is further configured to recognize a unit character in a unit area, and if the arrangement direction of the unit character is the standard direction, the pattern is in the standard direction;
and if the arrangement direction of the unit characters is a non-standard direction, adjusting the pattern to the standard direction.
Optionally, the pattern recognition module is configured to determine whether the braille characters at the edge of the pattern are complete, and if not, the pattern recognition module is further configured to send a prompt signal for continuing to collect the braille carrier.
Optionally, the pressure sensor is further used for collecting the pattern formed by the pressure contacts formed on the pressure sensor by the Braille carrier again;
the pattern recognition module is also used for merging the same parts of the originally acquired pattern and the reacquired pattern and splicing the originally acquired pattern and the reacquired pattern.
Optionally, the braille identification device further comprises a text conversion module for converting the braille characters into text.
Optionally, the braille identification device further comprises a voice conversion module for converting the braille characters into voice signals.
Optionally, the braille identification device further comprises a voice conversion module for converting the words into voice signals.
Optionally, the braille identification device further comprises a voice playing module for playing the voice signal.
Optionally, the pressure sensor comprises a 3D Touch sensor.
The invention also provides terminal equipment, and the terminal equipment comprises the Braille identification device.
Optionally, the braille identification device is further configured to convert the braille characters into instructions for operating the terminal device.
The invention also provides a Braille identification method, which comprises the following steps:
collecting patterns formed by pressure contacts formed on the pressure sensor by the Braille carrier;
and recognizing the pattern as braille characters.
Optionally, the step of recognizing the pattern as braille characters includes:
and adjusting the pattern to a standard direction according to the arrangement direction of the points in the pattern.
Optionally, the step of adjusting the pattern to a standard direction includes:
identifying unit characters in a unit area, wherein if the arrangement direction of the unit characters is the standard direction, the pattern is in the standard direction;
and if the arrangement direction of the unit characters is a non-standard direction, adjusting the pattern to the standard direction.
Optionally, the step of recognizing the pattern as braille characters includes:
and judging whether the Braille characters at the edges of the patterns are complete or not, and if not, sending a prompt signal for continuously acquiring the Braille carrier.
Optionally, after sending a prompt signal for continuing to collect the braille carrier, the method further includes the following steps:
and collecting the patterns formed by the pressure contacts formed on the pressure sensor by the Braille carrier again, combining the same parts of the originally collected patterns and the patterns collected again, and splicing the originally collected patterns and the patterns collected again.
Optionally, the braille identification method further includes the steps of:
and converting the Braille characters into words.
Optionally, the braille identification method further includes the steps of:
and converting the braille characters into voice signals.
Optionally, the braille identification method further includes the steps of:
and converting the text into a voice signal.
Optionally, the braille identification method further includes the steps of:
and playing the voice signal.
The positive progress effects of the invention are as follows: by adopting the Braille identification device, the terminal equipment and the Braille identification method, interactive equipment such as an intelligent terminal and the like can identify Braille, so that special groups can conveniently read Braille data, and the equipment is convenient to use.
Drawings
Fig. 1 is a schematic view of a braille identification device of embodiment 1 of the invention.
Fig. 2 is a partial schematic view of a pattern acquired by a pressure sensor of the braille recognition device of embodiment 1 of the invention.
Fig. 3 is a schematic view of a first pattern acquired by a pressure sensor of the braille recognition device of embodiment 2 of the invention.
Fig. 4 is a schematic view of a second pattern acquired by the pressure sensor of the braille recognition device of embodiment 2 of the invention.
Fig. 5 is a schematic view of a third pattern acquired by the pressure sensor of the braille recognition device of embodiment 2 of the invention.
Fig. 6 is a schematic view of an alternative embodiment of the braille identification device of embodiment 2 of the invention.
Fig. 7 is a schematic diagram of a terminal device according to embodiment 3 of the present invention.
Fig. 8 is a flowchart of a braille identification method of embodiment 5 of the invention.
Fig. 9 is a flowchart of an alternative embodiment of a braille identification method of embodiment 5 of the invention.
FIG. 10 is a flow chart of an alternative embodiment of a Braille identification method of embodiment 5 of the present invention.
Detailed Description
The invention is further illustrated by the following examples, which are not intended to limit the scope of the invention.
Example 1
Referring to fig. 1, an embodiment of the present invention provides a braille identification device including a pressure sensor 101 and a pattern recognition module 102. The pressure sensor 101 is used to collect a pattern of pressure contacts formed by the braille carrier on the pressure sensor 101. The pattern recognition module 102 is used to recognize the pattern as braille.
The pattern recognition module 102 stores a braille character library therein, and the pattern recognition module 102 compares a combination of dots in each cell region with characters in the braille character library, and recognizes the combination of dots in the cell region as braille.
The Braille recognition device of the embodiment provides great convenience for reading Braille data for special groups.
Example 2
In order to provide greater convenience and improve the recognition accuracy, in the braille recognition device of the present embodiment, on the basis of embodiment 1, the pattern recognition module 102 is configured to adjust the pattern to a standard direction, that is, a direction in which the braille characters are arranged in a normal lateral direction and a normal longitudinal direction, according to the arrangement direction of the dots in the pattern. The method specifically comprises the following steps: rotating the acquired pattern to a standard direction when the pattern is deflected relative to the standard direction; when the acquired pattern is inverted with respect to the standard orientation, the pattern is rotated to the standard orientation or mirror-inverted as appropriate.
As shown in fig. 3, the pattern acquired by the pressure sensor 101 is reversed left to right compared to the original direction of the braille carrier because of the pressing direction, and therefore, the characters contained in the pattern are also reversed left to right. The pattern recognition module 102 turns the left and right images of the pattern and adjusts the pattern to a standard orientation.
When the direction of the braille carrier is skewed with respect to the placement of the pressure sensor 101, the pattern acquired by the pressure sensor 101 will exhibit the effect as shown in fig. 4. At this time, the pattern recognition module 102 recognizes a standard direction, i.e., a direction in which the braille characters are arranged in the normal lateral and longitudinal directions, based on the arrangement direction of the dots in the pattern. The specific process is as follows:
when the pattern recognition module 102 recognizes 3 equally spaced points in the pattern, the distance between every two adjacent points is D1Then, the 3 dots are judged to be 3 dots arranged longitudinally in one certain 'side' (namely, the left 3 dots or the right 3 dots), the arrangement direction of the braille characters in the whole pattern in the longitudinal direction is judged according to the arrangement direction of the 3 dots, and the pattern is further adjusted to the horizontal direction according to the arrangement direction of the braille characters in the transverse direction and the longitudinal direction, but the pattern may not be the expected 'standard direction'.
Next, the pattern recognition module 102 locates the position of each "party" in the pattern adjusted into the horizontal direction. The specific positioning method comprises the following steps: because the transverse and longitudinal directions of the pattern are determined, i.e. the transverse and longitudinal directions of one side are located, the pattern recognition module 102 can calculate the distance D between two adjacent sides according to the arrangement rule of the points in the transverse direction3I.e. above D1In the range of (1), the minimum value of the distance between two points in the lateral direction is the distance D between two adjacent ones in the lateral direction3. In a similar manner, the pattern recognition module 102 can calculate the distance D between two adjacent "sides" in the longitudinal direction4. The pattern recognition module 102 divides the pattern into a plurality of unit areas according to the arrangement direction and the distance characteristic of the dots in the pattern, and each unit area corresponds to one party.
Then, the pattern recognition module 102 matches the arrangement of the dots in each "party" with the characters in the braille character library, and recognizes the braille characters corresponding to the "party". If no matched character is found in the Braille character library in the matching process, turning the 'one part' left and right in a mirror image manner, then matching with the character in the Braille character library, if the matching is possible, temporarily considering that the pattern is reversed left and right, and then turning all the 'one part' left and right in a mirror image manner for identification; if after left-right turning the mirror image, still find the "party" that can't match, think that the possible pattern is upside down, then rotate the pattern 180 °, then recognize all "parties"; if one party can not be identified, the original pattern is considered to be upside down instead of left and right, the current pattern is turned over in a left-right mirror mode, and then all the parties are identified again. By analogy, the standard orientation of the pattern is confirmed and all "one" is recognized as braille characters.
In the process of acquiring the pattern by the pressure sensor 101, there may be a case where the pressure sensor 101 cannot be completely acquired at one time because the braille carrier has a large area. Therefore, the pattern recognition module 102 of this embodiment is further configured to determine whether the braille characters at the edges of the pattern are complete, and if not, the pattern recognition module 102 is further configured to send a prompt signal for continuing to collect the braille carrier.
If one side at the edge of the pattern can not be identified through the identification steps, the incomplete braille characters at the edge are judged, and then the pattern is judged to be a part of the braille carrier, the section of braille data is not completely acquired, so that the pattern identification module 102 is also used for sending out a prompt signal for continuously acquiring the braille carrier. As shown in fig. 5, in which the combination of dots in the dashed box are incomplete braille characters at the edges of the pattern.
After receiving the prompt signal for continuing to collect the braille carrier, the operator presses the braille carrier against the surface of the pressure sensor 101 again, and the pressure sensor 101 collects the pattern formed by the pressure contact formed on the pressure sensor 101 by the braille carrier again. The pattern recognition module 102 combines the same portions of the original and the re-acquired patterns, and splices the original and the re-acquired patterns. The pattern recognition module 102 can recognize the same part of the original collected pattern and the re-collected pattern according to the similarity and the correlation between the part of the original collected pattern and the part of the re-collected pattern, combine the same part of the original collected pattern and the re-collected pattern, and splice the original collected pattern and the re-collected pattern. The pattern recognition module 102 recognizes the braille characters according to the recognition steps. If the incomplete braille characters at the edge are still found, the prompt signal for continuously collecting the braille carrier is sent out again, and the braille identification device repeats the processes of re-obtaining, pattern combination and re-identification until the information on the braille carrier is completely identified.
As an alternative embodiment, as shown in fig. 6, the braille recognition device of the present invention further includes a text conversion module 103 for converting the braille characters recognized by the pattern recognition module 102 into text. The users with normal vision can use the Braille recognition device to obtain the information on the Braille carrier so as to exchange knowledge with special groups or share reading thoughts according to the information, or transfer the content on the Braille carrier for the special groups.
The braille identification device of the embodiment further comprises a voice conversion module 104 for converting braille characters into voice signals; or, the voice conversion module 104 is configured to convert the text converted by the text conversion module 103 into a voice signal. Further, the braille identification device of the embodiment further includes a voice playing module 105, which is used for playing the voice signal converted by the voice converting module 104 to the outside. At the moment, users of special groups do not need to use a touch mode to 'read' the Braille carrier, but can use the Braille identification device to listen to information on the Braille carrier, thereby obtaining great convenience and improving efficiency.
Example 3
On the basis of the foregoing two embodiments, the present embodiment provides a terminal device, as shown in fig. 7, which includes the braille identification apparatus of the present invention. The terminal equipment has the advantages and the effects of the Braille identification device, and can provide convenience for users.
For example, the terminal device includes, but is not limited to, a smart phone or a tablet computer provided with the braille identification device of the present invention, a touch screen of the smart phone or the tablet computer is a pressure sensor, and a CPU (central processing unit) or a GPU (graphics processing unit) of the smart phone or the tablet computer is a graphic identification module. And pressing the Braille carrier on the surface of the touch screen, obtaining a pattern formed by the pressure contact points by the touch screen, and identifying the pattern as Braille characters by the CPU or the GPU.
Example 4
In order to facilitate the special group to use the terminal device of the present invention, on the basis of embodiment 3, the braille recognition device of the terminal device of the present embodiment is further configured to convert the recognized braille characters into instructions for operating the terminal device.
For example, the terminal device includes, but is not limited to, a smart phone or a tablet computer provided with the braille identification device of the present invention, a touch screen of the smart phone or the tablet computer is a pressure sensor, and a CPU (central processing unit) or a GPU (graphics processing unit) of the smart phone or the tablet computer is a graphic identification module. And pressing the Braille carrier on the surface of the touch screen, obtaining a pattern formed by the pressure contact points by the touch screen, and identifying the pattern as Braille characters by the CPU or the GPU. Further, instructions such as "make a call", etc. can be recorded on the braille carrier, and the smartphone automatically makes a call after recognizing the instructions. The method provides great convenience for special groups to use the terminal equipment of the invention, and enriches the means of man-machine interaction.
Example 5
The present embodiment provides a method for identifying braille, as shown in fig. 8, the method for identifying braille includes the following steps:
s401, collecting patterns formed by pressure contacts formed on the pressure sensor by the Braille carrier.
S402, recognizing the patterns as Braille characters.
In specific implementation, the braille carrier is pressed on the surface of the pressure sensor, and the pressure sensor acquires a pattern formed by a series of pressure contacts formed on the surface of the pressure sensor by braille convex points on the braille carrier (as shown in fig. 3). Fig. 2 shows a part of the pattern. Calculating the minimum distance between two transverse adjacent points according to the arrangement rule of the points in the pattern, and eliminating the occasional interference of small distance values which do not repeatedly appear by a statistical method, wherein the minimum distance is the distance D between two transverse points in one party1The distance is equal to the distance D between two longitudinally adjacent points in one direction2. Calculating the horizontal direction according to the arrangement rule of the points on the horizontal directionTo the distance D between two adjacent 'one' s3I.e. above D1In the range of (1), the minimum value of the distance between two points in the lateral direction is the distance D between two adjacent ones in the lateral direction3. Using a similar method, the distance D between two longitudinally adjacent "parties" can be calculated4. Then, the pattern is divided into a plurality of unit areas according to the arrangement direction and distance characteristics of the dots in the pattern, each unit area corresponding to one side (unit character). The combination of dots in each cell region is then compared to the characters in the library of Braille characters, identifying the combination of dots in that cell region as Braille.
Example 6
In order to improve the accuracy of the braille character recognition, on the basis of embodiment 5, in the braille recognition method of this embodiment, in an optional implementation manner of S402, the pattern is further adjusted to a standard direction, that is, a direction in which the braille characters are arranged in the normal transverse direction and the normal longitudinal direction, according to the arrangement direction of the dots in the pattern. The method specifically comprises the following steps: rotating the acquired pattern to a standard direction when the pattern is deflected relative to the standard direction; when the acquired pattern is inverted with respect to the standard orientation, the pattern is rotated to the standard orientation or mirror-inverted as appropriate.
As shown in fig. 3, the pattern obtained by the pressure sensor is reversed left and right compared with the original direction of the braille carrier due to the pressing direction, and therefore, the characters included in the pattern are also reversed left and right, and therefore, in the recognition process, the pattern is first reversed left and right in a mirror image manner, and the pattern is adjusted to a standard direction.
When the direction of the braille carrier is skewed with respect to the placement of the pressure sensors, the pattern captured by the pressure sensors will exhibit the effect shown in fig. 4. At this time, a standard direction, i.e., a direction in which the braille characters are arranged in the normal lateral and longitudinal directions, is recognized first according to the arrangement direction of the dots in the pattern. An alternative implementation of S402, as shown in fig. 9, includes the following specific processes:
s4021, identifying unit characters in the unit area;
s4022, judging whether the arrangement direction of the unit characters is a standard direction, if not, performing the step S4023; if yes, go to step S4024;
s4023, adjusting the pattern to a standard direction;
s4024, identifying the unit characters in the unit area as Braille characters.
In a specific implementation, 3 points arranged in the vertical direction (i.e. 3 points on the left side or 3 points on the right side) in a certain "one side" are firstly determined in the pattern. When 3 points arranged at equal intervals are identified in the pattern, and the distance between every two adjacent points is D1Then, the 3 points are judged to be 3 points which are longitudinally arranged in one certain 'side', the arrangement direction of the braille characters in the whole pattern in the longitudinal direction is judged according to the arrangement direction of the 3 points, and the pattern is further adjusted to the horizontal direction according to the arrangement direction, namely the direction in which the braille characters are arranged in the transverse direction and the longitudinal direction, but the direction may not be the expected 'standard direction'.
Next, in the pattern adjusted into the horizontal direction, the position of each "one side" is located. The specific positioning method comprises the following steps: because the transverse and longitudinal directions of the pattern are determined, namely the transverse and longitudinal directions of one side are positioned, the distance D between two adjacent sides in the transverse direction can be calculated according to the arrangement rule of points in the transverse direction3I.e. above D1In the range of (1), the minimum value of the distance between two points in the lateral direction is the distance D between two adjacent ones in the lateral direction3. Using a similar method, the distance D between two longitudinally adjacent "parties" can be calculated4. Then, the pattern is divided into a plurality of unit areas according to the arrangement direction and the distance characteristic of the points in the pattern, and each unit area corresponds to one party.
Then, the arrangement mode of the points in each party is matched with the characters in the Braille character library, and the Braille characters corresponding to the party are identified. If no matched character is found in the Braille character library in the matching process, turning the 'one part' left and right in a mirror image manner, then matching with the character in the Braille character library, if the matching is possible, temporarily considering that the pattern is reversed left and right, and then turning all the 'one part' left and right in a mirror image manner for identification; if after left-right turning the mirror image, still find the "party" that can't match, think that the possible pattern is upside down, then rotate the pattern 180 °, then recognize all "parties"; if one party can not be identified, the original pattern is considered to be upside down instead of left and right, the current pattern is turned over in a left-right mirror mode, and then all the parties are identified again. By analogy, the standard orientation of the pattern is confirmed and all "one" is recognized as braille characters.
In the process of acquiring patterns by the pressure sensor, the condition that the pressure sensor cannot acquire patterns completely at one time due to the fact that the area of the Braille carrier is large is also possible. For this reason, in another alternative embodiment of S402, as shown in fig. 10, the method further includes the following steps:
s411, judging whether the Braille characters at the edges of the patterns are complete, if not, executing the step S412; if yes, go to step S415;
s412, sending out a prompt signal for continuously collecting the Braille carrier;
s413, collecting patterns formed by pressure contacts formed on the pressure sensor by the Braille carrier again;
s414, splicing the originally acquired pattern with the acquired pattern again, taking the spliced new pattern as an identification object, and returning to the step S411;
and S415, identifying the unit characters in the unit area as braille characters.
In specific implementation, if the pattern collected initially is subjected to the identification step, one side at the edge of the pattern cannot be identified, the incomplete braille characters at the edge are judged, the pattern is judged to be a local part of the braille carrier, the braille data at the section are obtained incompletely, and then a prompt signal for continuously collecting the braille carrier is sent. As shown in fig. 5, in which the combination of dots in the dashed box are incomplete braille characters at the edges of the pattern.
And after receiving the prompt signal for continuously collecting the Braille carrier, the operator presses the Braille carrier on the surface of the pressure sensor again, and the pressure sensor collects the pattern formed by the pressure contact formed on the pressure sensor by the Braille carrier again. And then combining the same parts of the originally acquired pattern and the reacquired pattern, and splicing the originally acquired pattern and the reacquired pattern. The splicing can be realized through a graphic processing tool, the graphic processing tool identifies the same part in the original collected pattern and the recollected pattern according to the local similarity and the correlation degree of the original collected pattern and the secondary collected pattern, combines the same part of the original collected pattern and the secondary collected pattern, and splices the original collected pattern and the secondary collected pattern. Then, the Braille character is identified according to the identification step. If the incomplete Braille characters at the edge are still found, the prompt signal for continuously collecting the Braille carrier is sent again, and the processes of obtaining again, combining patterns and identifying again are repeated according to the Braille identification method of the embodiment until the information on the Braille carrier is completely identified.
In an alternative embodiment of S402, the method further includes the step of converting the braille characters into text. The users with normal vision can use the Braille identification method to obtain the information on the Braille carrier so as to exchange knowledge with special groups or share reading thoughts, or transfer the content on the Braille carrier for the special groups.
In another optional implementation manner of S402, the method further includes a step of converting braille characters into a voice signal, or a step of converting the text converted by the text conversion module into a voice signal. Further, a voice playing device is also used for playing the voice signal. At the moment, users of special groups do not need to use a touch mode to 'read' the Braille carrier, but can use the Braille identification method to listen to the information on the Braille carrier, thereby obtaining great convenience and improving the efficiency.
In summary, the above is provided. By adopting the Braille identification device, the terminal equipment and the Braille identification method, interactive equipment such as an intelligent terminal and the like can identify Braille, so that special groups can conveniently read Braille data, the equipment is convenient to use, and the man-machine interaction experience is improved.
While specific embodiments of the invention have been described above, it will be appreciated by those skilled in the art that these are by way of example only, and that the scope of the invention is defined by the appended claims. Various changes and modifications to these embodiments may be made by those skilled in the art without departing from the spirit and scope of the invention, and these changes and modifications are within the scope of the invention.
Claims (10)
1. A Braille recognition device is characterized by comprising a pressure sensor and a pattern recognition module;
the pressure sensor is used for collecting patterns formed by pressure contacts formed on the pressure sensor by the Braille carrier;
the pattern recognition module is used for dividing the pattern into a plurality of unit areas according to the arrangement direction and the distance characteristic of the points in the pattern, and each unit area corresponds to one unit character;
the pattern recognition module is used for recognizing the patterns as braille characters;
the pattern recognition module is used for judging whether the Braille characters at the edges of the patterns are complete or not, and if not, the pattern recognition module is also used for sending a prompt signal for continuously collecting the Braille carrier;
the pressure sensor is also used for collecting patterns formed by pressure contacts formed on the pressure sensor by the Braille carrier again;
the pattern recognition module is also used for merging the same parts of the originally acquired pattern and the reacquired pattern and splicing the originally acquired pattern and the reacquired pattern.
2. A braille recognition device according to claim 1, characterized in that the pattern recognition module is adapted to adjust the pattern to a standard orientation in dependence on the direction of arrangement of the dots in the pattern.
3. A braille identification device according to claim 2, characterized in that the pattern recognition module is further adapted to recognize a unit character in a unit area, and if the arrangement direction of the unit character is the standard direction, the pattern is in the standard direction;
and if the arrangement direction of the unit characters is a non-standard direction, adjusting the pattern to the standard direction.
4. A braille identification device according to claim 1, characterized in that the braille identification device further comprises a text conversion module for converting the braille characters into text; and/or the presence of a gas in the gas,
the Braille recognition device also comprises a voice conversion module which is used for converting the Braille characters into voice signals;
the voice conversion module is also used for converting the characters into voice signals;
the Braille recognition device also comprises a voice playing module used for playing the voice signal.
5. A terminal device characterized in that it contains a Braille recognition arrangement according to any of claims 1-4.
6. A terminal device as claimed in claim 5, characterized in that the Braille recognition means are also adapted to convert the Braille characters into instructions for operating the terminal device.
7. A Braille identification method is characterized by comprising the following steps:
collecting patterns formed by pressure contacts formed on the pressure sensor by the Braille carrier;
dividing the pattern into a plurality of unit areas according to the arrangement direction and the distance characteristics of the points in the pattern, wherein each unit area corresponds to one unit character;
recognizing the pattern as braille characters;
the recognizing the pattern as the braille characters includes:
judging whether the Braille characters at the edges of the patterns are complete or not, and if not, sending a prompt signal for continuously collecting the Braille carriers;
after sending out the prompt signal for continuously collecting the Braille carrier, the method also comprises the following steps:
and collecting the patterns formed by the pressure contacts formed on the pressure sensor by the Braille carrier again, combining the same parts of the originally collected patterns and the patterns collected again, and splicing the originally collected patterns and the patterns collected again.
8. A braille identification method according to claim 7, characterized in that the step of identifying the pattern as braille characters comprises:
and adjusting the pattern to a standard direction according to the arrangement direction of the points in the pattern.
9. A braille identification method according to claim 8, characterized in that the step of adjusting the pattern to a standard orientation comprises:
identifying unit characters in a unit area, wherein if the arrangement direction of the unit characters is the standard direction, the pattern is in the standard direction;
and if the arrangement direction of the unit characters is a non-standard direction, adjusting the pattern to the standard direction.
10. A braille identification method according to claim 7, characterized in that the braille identification method further comprises the steps of:
converting the braille characters into words; or the like, or, alternatively,
and converting the braille characters into voice signals.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710938858.6A CN107678595B (en) | 2017-09-30 | 2017-09-30 | Braille recognition device, terminal device, and Braille recognition method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710938858.6A CN107678595B (en) | 2017-09-30 | 2017-09-30 | Braille recognition device, terminal device, and Braille recognition method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107678595A CN107678595A (en) | 2018-02-09 |
| CN107678595B true CN107678595B (en) | 2020-11-03 |
Family
ID=61140105
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710938858.6A Active CN107678595B (en) | 2017-09-30 | 2017-09-30 | Braille recognition device, terminal device, and Braille recognition method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107678595B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109754676A (en) * | 2018-12-17 | 2019-05-14 | 浙江理工大学 | A kind of roller Braille reading pen for the identification of papery books for the blind |
| CN111103076A (en) * | 2019-12-18 | 2020-05-05 | 上海交通大学 | Wearable Braille identification system, identification method and preparation method thereof |
| CN113223377A (en) * | 2021-04-25 | 2021-08-06 | 浙江理工大学 | Braille reading pen and Braille reading method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009095A (en) * | 2007-01-24 | 2007-08-01 | 蒋清晓 | Fully-automatic intelligent blind reader |
| CN101527093A (en) * | 2009-04-22 | 2009-09-09 | 邓毅华 | Digital terminal supporting Braille input and Braille input method |
| CN105551346A (en) * | 2016-03-11 | 2016-05-04 | 京东方科技集团股份有限公司 | Communication auxiliary system, communication auxiliary equipment and control method of communication auxiliary equipment |
| CN105844679A (en) * | 2016-04-06 | 2016-08-10 | 华建宇通科技(北京)有限责任公司 | Method and device for complex braille dot pattern drafting and embedded character input |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101770298B (en) * | 2008-12-30 | 2012-06-06 | 北京联想软件有限公司 | Input device and input method |
| CN102156608B (en) * | 2010-12-10 | 2013-07-24 | 上海合合信息科技发展有限公司 | Handwriting input method for writing characters continuously |
| CN103995600B (en) * | 2014-03-20 | 2017-06-23 | 江苏科技大学 | A kind of braille Chinese character converter and its method |
-
2017
- 2017-09-30 CN CN201710938858.6A patent/CN107678595B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009095A (en) * | 2007-01-24 | 2007-08-01 | 蒋清晓 | Fully-automatic intelligent blind reader |
| CN101527093A (en) * | 2009-04-22 | 2009-09-09 | 邓毅华 | Digital terminal supporting Braille input and Braille input method |
| CN105551346A (en) * | 2016-03-11 | 2016-05-04 | 京东方科技集团股份有限公司 | Communication auxiliary system, communication auxiliary equipment and control method of communication auxiliary equipment |
| CN105844679A (en) * | 2016-04-06 | 2016-08-10 | 华建宇通科技(北京)有限责任公司 | Method and device for complex braille dot pattern drafting and embedded character input |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107678595A (en) | 2018-02-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3336733B1 (en) | Fingerprint recognition system and method, and display apparatus | |
| CN107678595B (en) | Braille recognition device, terminal device, and Braille recognition method | |
| EP3163504B1 (en) | Method, device and computer-readable medium for region extraction | |
| CN105205439B (en) | Method for calculating area of fingerprint overlapping region and electronic device | |
| KR101857287B1 (en) | Method and apparatus of a gesture based biometric system | |
| CN109684980B (en) | Automatic scoring method and device | |
| US9239961B1 (en) | Text recognition near an edge | |
| CN104023249A (en) | Method and device of identifying television channel | |
| CN105260733A (en) | Method and device for processing image information | |
| CN105528576A (en) | Method and device for inputting fingerprint | |
| CN105447437A (en) | Fingerprint identification method and device | |
| CN107977659A (en) | A kind of character recognition method, device and electronic equipment | |
| CN104881238A (en) | Touch control display device and touch control method thereof | |
| JP2010231686A (en) | Device, method and program for extracting document area from image | |
| US20070172123A1 (en) | Image processing apparatus, image processing method and computer readable medium | |
| CN111898520A (en) | Certificate authenticity identification method and device, computer readable medium and electronic equipment | |
| JP2012068690A (en) | Finger gesture detection device | |
| CN110443237B (en) | Certificate identification method, device, electronic equipment and computer readable storage medium | |
| CN111553251A (en) | Certificate four-corner incomplete detection method, device, equipment and storage medium | |
| JP6739937B2 (en) | Information processing apparatus, control method of information processing apparatus, and program | |
| CN112001200A (en) | Identification code identification method, device, equipment, storage medium and system | |
| CN111340045B (en) | License plate number recognition method, device and storage medium | |
| US9830531B2 (en) | Image processing apparatus, image processing method and non-transitory computer readable medium storing image processing program | |
| CN107977636A (en) | Method for detecting human face and device, terminal, storage medium | |
| CN102917234B (en) | Image processing apparatus and method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |