CN113160666B - Braille reading method, electronic device and storage medium - Google Patents

Braille reading method, electronic device and storage medium Download PDF

Info

Publication number
CN113160666B
CN113160666B CN202110518911.3A CN202110518911A CN113160666B CN 113160666 B CN113160666 B CN 113160666B CN 202110518911 A CN202110518911 A CN 202110518911A CN 113160666 B CN113160666 B CN 113160666B
Authority
CN
China
Prior art keywords
reading
vibration
user
read
braille
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110518911.3A
Other languages
Chinese (zh)
Other versions
CN113160666A (en
Inventor
肖冯敏
贾光耀
夏承平
刘灏宇
杨琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Migu Cultural Technology Co Ltd
China Mobile Communications Group Co Ltd
MIGU Digital Media Co Ltd
Original Assignee
Migu Cultural Technology Co Ltd
China Mobile Communications Group Co Ltd
MIGU Digital Media Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Migu Cultural Technology Co Ltd, China Mobile Communications Group Co Ltd, MIGU Digital Media Co Ltd filed Critical Migu Cultural Technology Co Ltd
Priority to CN202110518911.3A priority Critical patent/CN113160666B/en
Publication of CN113160666A publication Critical patent/CN113160666A/en
Application granted granted Critical
Publication of CN113160666B publication Critical patent/CN113160666B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001Teaching or communicating with blind persons
    • G09B21/003Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001Teaching or communicating with blind persons
    • G09B21/003Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays
    • G09B21/004Details of particular tactile cells, e.g. electro-mechanical or mechanical layout

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention provides a braille reading method and device, electronic equipment and a storage medium. The method comprises the following steps: determining target reading characters from the characters to be read based on the operation of a user; translating the target reading characters into six-point braille, and converting the six-point braille of the target reading characters into vibration codes of the target reading characters by taking each three-point braille in the six-point braille as a conversion unit; and generating vibration according to the vibration code of the target reading text. According to the Braille reading method, the electronic equipment and the storage medium, each three-point Braille in the six-point Braille is used as a conversion unit, one six-point Braille of target reading characters is converted into two independent vibration codes, and for a single vibration code, the complexity of the codes can be reduced, the memory difficulty of a user is reduced, so that the recognition rate is improved, and the reading speed is further improved; and the vibration coding has better expansibility and more combination possibility, and is convenient to expand common words and common sentence patterns.

Description

Braille reading method, electronic device and storage medium
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a braille reading method, an electronic device, and a storage medium.
Background
In order to help the blind to obtain external information, there are various methods or devices in the prior art for assisting the blind in reading.
For example, kes Braille reader photographs the characters in a physical book by a photographing device and then converts the characters into Braille; the human Braille reader is connected with mobile terminal equipment (such as a mobile phone) through external equipment, and converts characters displayed on a screen of the mobile terminal equipment in real time into Braille; the voiceover function provided by apple inc can directly read the text displayed on the screen of the mobile terminal device.
The methods or devices for assisting the blind in reading in the prior art have certain defects respectively. For example, kes braille readers need to be matched with physical books, the shooting and translation accuracy is limited, manual page turning is needed in the reading process, the operation is complex, and the user experience is poor. The set of external equipment is needed when the Humanware Braille reader is used, the Humanware Braille reader is not easy to carry, and the experience of single-line reading in the scenes of browsing and the like is poor. voiceover functionality is not suitable for use in noisy environments such as subways, buses, etc.
Disclosure of Invention
The invention provides a braille reading method, electronic equipment and a storage medium, aiming at the problems in the prior art.
In a first aspect, the present invention provides a braille reading method, including:
determining target reading characters from the characters to be read based on the operation of a user;
translating the target reading characters into six-point braille, and converting the six-point braille of the target reading characters into vibration codes of the target reading characters by taking each three-point braille in the six-point braille as a conversion unit;
and generating vibration according to the vibration code of the target reading text.
According to the braille reading method provided by the invention, before the target reading words are determined from the words to be read, the method further comprises the following steps:
determining whether the user is in a motion state currently or not according to the motion information acquired in real time;
when the user is in a motion state at present, increasing the word size of the words to be read and/or the distance between the words to be read when the words to be read are displayed;
the generating vibration according to the vibration code of the target reading text comprises the following steps:
and when the user is in a motion state at present, generating vibration according to the vibration code of the target reading text and the preset high vibration strength.
According to the braille reading method provided by the invention, before the target reading characters are determined from the characters to be read, the method further comprises the following steps:
counting the number of times that the characters to be read are selected in a preset time period;
when the number of times that the characters to be read are selected in a preset time period exceeds a preset number threshold, executing at least one of the following operations: increasing the word size of the words to be read when the words to be read are displayed and increasing the distance between the words to be read;
the generating vibration according to the vibration code of the target reading text comprises:
and when the selected times of the characters to be read in a preset time period exceed a preset time threshold, generating vibration according to the vibration code of the target reading characters and the preset high vibration strength.
According to the braille reading method provided by the invention, before the target reading characters are determined from the characters to be read, the method further comprises the following steps:
counting the accuracy of the operation of the user in a preset time period;
and when the accuracy is lower than a preset accuracy threshold, adjusting the display parameters of the characters to be read when the characters to be read are displayed.
According to the braille reading method provided by the invention, after the vibration is generated according to the vibration code of the target reading words, the method also comprises the following steps:
detecting whether the content to be reminded exists at present; the content to be reminded is the content needing to remind the user of paying attention;
when the content to be reminded is detected, determining the reading immersion level of the user at the current moment according to information which is collected in real time and used for representing whether the electronic equipment is in a mute mode or a vibration inhibiting mode and information which is used for representing whether the electronic equipment is in a motion state;
determining the reminding intensity aiming at the content to be reminded according to the reading immersion level of the user at the current moment and the corresponding relation between the preset reading immersion level and the reminding intensity;
and reminding the content to be reminded according to the determined reminding strength.
According to the braille reading method provided by the invention, the reading immersion level of the user at the current moment is determined according to the information which is collected in real time and is used for representing whether the electronic equipment is in a mute mode or a vibration inhibiting mode and the information which is used for representing whether the electronic equipment is in a motion state, and the braille reading immersion method comprises the following steps:
when the electronic equipment is currently in a mute mode, a vibration inhibiting mode and a non-motion state, determining that the reading immersion level of a user at the current moment is a first level;
when the electronic equipment is currently in a mute mode, a vibration inhibiting mode and a motion state, determining that the reading immersion level of the user at the current moment is a second level; the second level is lower than the first level;
when the electronic equipment is in a mute mode and in a motion state, determining that the reading immersion level of the user at the current moment is a third level; the third level is lower than the second level;
when the electronic equipment is not in a mute mode and is in a motion state, determining that the reading immersion level of the user at the current moment is a fourth level; the fourth level is lower than the third level.
According to the braille reading method provided by the invention, the step of determining the reminding strength aiming at the content to be reminded according to the reading immersion level of the user at the current moment and the corresponding relation between the preset reading immersion level and the reminding strength comprises the following steps:
and determining the reminding intensity aiming at the content to be reminded according to the type of the content to be reminded, the reading immersion level of the user at the current moment, the corresponding relation between the preset reading immersion level and the reminding intensity and the corresponding relation between the preset type of the content to be reminded and the reminding intensity.
In a second aspect, the present invention provides a braille reading device comprising:
the target reading character determining module is used for determining target reading characters from the characters to be read based on the operation of a user;
the vibration code conversion module is used for converting the target reading texts into six-point braille alphabets and converting the six-point braille alphabets of the target reading texts into vibration codes of the texts to be read by taking each three-point braille alphabets in the six-point braille alphabets as a conversion unit;
and the vibration module is used for generating vibration according to the vibration code of the target reading text.
In a third aspect, the present invention provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the braille reading method according to the first aspect of the invention when executing the program.
In a fourth aspect, the present invention provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the braille reading method according to the first aspect of the invention.
According to the Braille reading method, the electronic equipment and the storage medium, each three-point Braille in the six-point Braille is used as a conversion unit, one six-point Braille of a target reading character is converted into two independent vibration codes, for a single vibration code, the complexity of the codes can be reduced, the memory difficulty of a user is reduced, the recognition rate is improved, and the reading speed is further improved; and the vibration coding has better expansibility and more combination possibility, and is convenient to expand common words and common sentence patterns.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a flow chart of a Braille reading method provided by the present invention;
FIG. 2 is a schematic illustration of six point Braille in one embodiment;
FIG. 3 is a schematic diagram of six-point Braille for letter b;
FIG. 4 is one illustration of a column in a six-point Braille text in one embodiment;
FIG. 5 is a second diagram of a column in the six-point blind in one embodiment;
FIG. 6 is a schematic diagram of six-point Braille for Chinese characters "one" in one embodiment;
FIG. 7 is a schematic view of a braille reading device in accordance with the present invention;
fig. 8 is a schematic physical structure diagram of an electronic device according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without inventive step based on the embodiments of the present invention, are within the scope of protection of the present invention.
The braille reading method provided by the invention can be applied to any electronic equipment with an intelligent operating system, such as a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the embodiment of the invention is not particularly limited.
Fig. 1 is a flowchart of a braille reading method provided by the present invention, and as shown in fig. 1, the braille reading method provided by the present invention includes:
step 101, determining target reading characters from the characters to be read based on the operation of a user.
In the present invention, a user generally refers to a user who has a visual disorder.
The characters to be read refer to characters to be read by a user, such as a book and a file; the target reading characters refer to characters which need to be read by the user at the current moment. The types of the characters to be read and the target reading characters can be numbers, English letters or Chinese characters. The number of the target reading words can be a single word, a sentence or even a paragraph.
The operation of the user refers to an operation of selecting a target reading text on the electronic device by the user, for example, a touch operation of a finger of the user on a display screen of the electronic device. And the electronic equipment determines the characters to be read according to the occurrence position of the touch operation.
In this embodiment, the number of target reading characters can be determined based on the user operation and in combination with the preset reading mode. For example, the reading mode includes a single word reading mode, a word reading mode, and a continuous reading mode.
When the reading mode is the single character reading mode, the determined target reading characters are single characters touched by the touch operation through one touch operation of the user. The mode is suitable for users to use in a precise reading state, such as reading poetry and the like, and literary works needing fine and detailed tastes.
When the reading mode is the word reading mode, the determined target reading words are words touched by the touch operation through one touch operation of the user. This mode is mainly used in browsing and fast content search.
When the reading mode is the continuous reading mode, the determined target reading words are all words starting from a single word touched by the touch operation and ending at the designated termination position of the work to be read by one touch operation of the user. The specified termination location may be at the end of a chapter of the work, at the end of the entire work, or at the end pre-specified by the user.
102, translating the target reading characters into six-point braille, and converting the six-point braille of the target reading characters into vibration codes of the target reading characters by taking each three-point braille in the six-point braille as a conversion unit.
Six-dot braille is also known as braille. Fig. 2 is a schematic diagram of six-point braille, and as shown in fig. 2, the six-point braille uses 6 points as a basic symbol unit, each symbol is divided into two left and right columns, each column has three points, which are called 1,2 and 3 points from the left side to the top, and are called 4, 5 and 6 points from the right side to the top. By changing the states of different points in the six-point braille, specific meanings can be given to the six-point braille. For example, fig. 3 is a schematic diagram of six-point braille of the letter b, and as shown in fig. 3, in the six-point braille corresponding to the english letter b (or the initial consonant b in the pinyin), the states of two points, namely point 1 and point 2, are different from those of the other points. Therefore b can be expressed as six-dot braille (1, 2). Similarly, the letter c may be represented as six-point braille (1,4), and the letter p may be represented as six-point braille (1,2,3, 4).
In the prior art, the numbers, english letters, and pinyin for chinese characters have been correlated with six-point braille, and thus, the target reading text can be translated into six-point braille. If the target reading characters are Chinese characters or words formed by the Chinese characters, the pinyin of the Chinese characters can be obtained firstly, and then the pinyin of the Chinese characters is translated into six-point braille.
In the invention, each three-point Braille in the six-point Braille is taken as a basic unit for converting the vibration codes, and one six-point Braille symbol is converted into two vibration codes. In this embodiment, the columns in the six-point blind text can be used as the conversion units.
Specifically, in the present invention, the vibration can be divided into 3 states, which are single vibration, short vibration, and jerky vibration, respectively. The vibration frequencies of different vibration states are different, and the duration of each vibration state is the same, such as 0.5 second (other time length values can be set, and can be determined according to actual conditions). A list of values in a six-point blind text is then represented by a combination of different vibration states.
For example, assume that the state of a single vibration is denoted by "_"; the term "-" indicates a short vibration; the term "sharp vibration" is used. In addition, pauses can also be denoted by "", in order to distinguish between different vibration codes. A single vibration is a vibration only once in a period corresponding to one vibration state, for example, a vibration only once in 2 seconds. The short vibration refers to multiple vibrations within a period corresponding to one vibration state, and a time interval between the multiple vibrations is higher than or equal to a preset time threshold, for example, 2 vibrations within 2 seconds, and each vibration interval is 0.5 second. The jerky vibration refers to a plurality of vibrations within a period corresponding to a vibration state, and a time interval between the plurality of vibrations is lower than a preset time threshold, for example, 4 vibrations within 2 seconds, and each vibration interval is 0.2 seconds. The pause is that no vibration occurs in a period corresponding to a vibration state, for example, no vibration occurs in 2 seconds.
The above-mentioned vibration states are combined, and different combinations may represent different column values. For example, the column values in fig. 4 are represented with a vibration state combination "-"; the column values in fig. 5 are represented by a vibration state combination of- __ -.
The vibration state combination is marked as z1, the vibration state combination is marked as- __ -2, and if the six-point braille of the chinese character "one" is shown in fig. 6, the six-point braille of the chinese character "one" is converted into the vibration code of z2 z 1. Where "+" is the pause between the vibration encodings corresponding to different columns.
Referring to the above description, six states "001", "010", "011", "100", "101", and "111" of one column in the six-dot braille text can be respectively represented by six vibration state combinations, thereby converting the six-dot braille text into vibration codes. In addition, three special vibration modes of continuous and continuous vibration without beats, short and medium intensity vibration and high intensity vibration can be used as message reminding to distinguish the vibration codes for representing six-point Braille.
In the present embodiment, the correspondence relationship between the vibration state combination and the column value in the six-dot braille is not defined, and those skilled in the art can set the correspondence relationship according to actual conditions. For example, the vibration state combination which is easy to memorize can be allocated to the pinyin (or letters) with high frequency of use according to the frequency of use of the pinyin (or letters) represented by six-dot braille.
Once the correspondence between the vibration status combination and the column values in six-point Braille is set, it is not easy to modify, so as to avoid the user from being troubled.
And 103, generating vibration according to the vibration code of the target reading text.
In the previous step, the target reading script has been converted from six-dot Braille format to vibration encoded format. The vibration code can reflect information such as frequency, intensity and the like of vibration, and the electronic equipment vibrates according to the vibration code, so that the aim of transmitting information to a user is fulfilled.
The Braille reading method provided by the invention takes each three-point Braille in the six-point Braille as a conversion unit, converts one six-point Braille of the target reading character into two independent vibration codes, and thus for a single code, the complexity of the code can be reduced, the memory difficulty of a user is reduced, the recognition rate is improved, and the reading speed is further improved; on the other hand, the vibration coding has better expansibility and more combination possibility, and is convenient to expand common words and common sentence patterns.
Based on any one of the above embodiments, in this embodiment, after the step of determining the text to be read, the method further includes:
determining whether the user is in a motion state currently or not according to the motion information acquired in real time;
when the user is in a motion state at present, increasing the word size of the words to be read and/or the distance between the words to be read when the words to be read are displayed;
the generating vibration according to the vibration code of the target reading text comprises:
and when the user is in a motion state at present, generating vibration according to the vibration code of the target reading text and the preset high vibration strength.
In electronic devices such as mobile phones and tablet computers, a gyroscope is generally provided, which is also called an angular velocity detection device and can acquire information such as velocity and acceleration. Through a gyroscope built in the electronic equipment, the motion information including the speed and the acceleration of the user at the current moment can be obtained.
According to the motion information of the user at the current moment, whether the user is in a motion state at present can be determined. For example, when the current speed value acquired by the gyroscope is greater than a speed threshold, or the current acceleration value acquired by the gyroscope is greater than an acceleration threshold, it is determined that the user is currently in a motion state; and when the current speed value acquired by the gyroscope is less than or equal to the speed threshold value and the current acceleration value acquired by the gyroscope is less than or equal to the acceleration threshold value, determining that the user is in a static state at present.
The speed threshold and the acceleration threshold can be determined according to actual conditions, and both values are generally larger than 0, so that the user is considered to be in a static state even if the user is in a slow motion state, such as a walking state.
It is well known that the user's perception of the outside and control of his own actions will be impaired when the user is in motion. When the user runs, the user may not be able to sense the vibration of the mobile phone; and if the user is in a swaying car, the user may not accurately click the icon on the screen of the mobile phone. Therefore, in the embodiment, when the user is judged to be in the motion state, the word size of the words to be read when being displayed and/or the distance between the words to be read are increased, so that the user can more easily select the words which the user wants to read. In addition, when the user is in a motion state at present, vibration is generated according to the vibration code of the text to be read with preset high vibration intensity, so that the user can more clearly sense the information transmitted by the vibration.
As will be readily appreciated by those skilled in the art, another result of determining whether a user is currently in motion based on motion information collected in real time is that the user is stationary.
When a user is in a static state at present, reducing the font size of the characters to be read and/or the distance between the characters to be read when the characters to be read are displayed, generating vibration with preset low vibration strength according to the vibration codes of the characters to be read, or keeping the font size of the characters to be read and/or the distance between the characters to be read unchanged when the characters to be read are displayed, and keeping the vibration strength of the vibration generated according to the vibration codes of the characters to be read unchanged.
According to the Braille reading method, the word size and/or the distance of the characters to be read are/is adjusted by judging the current environment of the user, and the intensity of vibration is adjusted, so that the user can better acquire information, and the user experience is improved.
Based on any one of the above embodiments, in this embodiment, before determining the target reading text from the texts to be read, the method further includes:
counting the number of times that the characters to be read are selected in a preset time period;
when the number of times that the characters to be read are selected in a preset time period exceeds a preset number threshold, executing at least one of the following operations: increasing the word size of the words to be read when the words to be read are displayed and increasing the distance between the words to be read;
the generating vibration according to the vibration code of the target reading text comprises:
and when the selected times of the characters to be read in a preset time period exceed a preset time threshold, generating vibration according to the vibration code of the target reading characters and the preset high vibration strength.
As is well known, when a user selects a target reading character from characters to be read, if the selection result deviates from the user's expectation, it is a common practice for the user to select the target reading character from the characters to be read again. Therefore, the number of times that the characters to be read are selected in the preset time period can reflect the error rate of the user in the process of selecting the characters to be read to a great extent.
When the number of times that the characters to be read are selected in the preset time period exceeds the preset number threshold, it indicates that the probability that the user selects the wrong characters to be read is high, which may affect the user experience. Therefore, in this case, some measures need to be taken to reduce the probability that the user selects the wrong text to be read.
Another possible situation that the user reselects the target reading text from the text to be read is that although the user has not selected the error, the vibration information corresponding to the target reading text is not clearly received by the user. In this case, some measures need to be taken to make it easier for the user to perceive the vibration information.
In this embodiment, the probability that the user selects the wrong text to be read can be reduced by increasing the font size of the text to be read when displayed and/or increasing the distance between the texts to be read, and/or when the vibration is generated according to the vibration code of the target text to be read, the vibration is generated with a preset high vibration strength, so that the user can more easily perceive the vibration information.
The user increases the font size of the words to be read when displayed, increases the distance between the words to be read, and generates vibration with preset high vibration strength in a mode of interactive pages. In this embodiment, the implementation manner is not particularly limited.
According to the Braille reading method, the number and/or the distance of the characters to be read are/is adjusted or the vibration strength is adjusted by counting the number of times that the characters to be read are selected in the preset time period, so that a user can better acquire information, and the user experience is improved.
Based on any one of the above embodiments, in this embodiment, after the step of determining the text to be read, the method further includes:
counting the accuracy of the operation of the user in a preset time period;
and when the accuracy of the user operation is lower than a preset accuracy threshold, adjusting the display parameters of the characters to be read during display.
In the previous embodiment, the repeated selection of the text to be read by the user may be caused by the user operation or the failure of the user to accurately recognize the vibration information. In the present embodiment, a problem caused by a user operation is discussed.
In order to improve the user experience, the accuracy of the user operation may be counted within a preset time period (e.g., within one day).
The multiple clicks of the adjacent characters by the user can be regarded as an invalid click, and the accuracy calculation formula is as follows: (total number of clicks-invalid clicks)/total number of clicks.
When the accuracy is lower than the preset accuracy threshold, it is indicated that the user operation error is mainly not caused by subjective reasons such as carelessness and the like of the user, and objective factors need to be adjusted at the moment.
In the embodiment, the accuracy is improved by the display parameters of the characters to be read when the characters are displayed. The display parameters are parameters related to text display, and common display parameters include a font size, a click threshold value and the like.
For example, when the accuracy is counted, the reason of the user's wrong operation can be known, and if the ratio of the text before and after the user touches the touch pad by mistake is higher than a preset first ratio threshold, it indicates that the font size of the text to be read is too small when displayed on the display screen of the electronic device, and at this time, the font size needs to be increased. If the proportion that the user touches the same character by mistake is higher than the preset second proportion threshold value, the character size of the character to be read displayed on the display screen of the electronic equipment is too large, and the character size needs to be reduced at the moment. If the phenomenon of false touch frequently occurs, which may mean that the sensitivity of the stylus is too high, the threshold for clicking during reading needs to be increased at the moment, so as to avoid false touch.
According to the Braille reading method, the accuracy of the operation of the user in the preset time period is counted, and the display parameters of the characters to be read during display are adjusted according to the accuracy, so that the user can better acquire information, and the user experience is improved.
Based on any one of the above embodiments, in this embodiment, the method further includes:
detecting whether the content to be reminded exists at present; the content to be reminded is the content needing to remind the user of paying attention;
when the content to be reminded is detected, determining the reading immersion level of the user at the current moment according to information which is collected in real time and used for representing whether the electronic equipment is in a mute mode or a vibration inhibiting mode and information which is used for representing whether the electronic equipment is in a motion state;
determining the reminding intensity aiming at the content to be reminded according to the reading immersion level of the user at the current moment and the corresponding relation between the preset reading immersion level and the reminding intensity;
and reminding the content to be reminded according to the determined reminding strength.
In this embodiment, the content to be reminded is content that needs to remind the user of paying attention. Such as incoming calls, pushed messages, received short messages, etc. Those skilled in the art will appreciate that different content to be reminded may have different degrees of urgency. For example, the urgency of a phone is higher than that of a short message.
The reading immersion level of the user at the current moment reflects the effort of the user on reading at the current moment. Those skilled in the art will appreciate that a user often does not want to be disturbed while focusing on reading, and once disturbed, the reading experience of the user will be reduced. However, at the same time, if the electronic device receives the crucial content to be reminded, the user may want to obtain the content to be reminded in time even if the user is attentive to reading.
Therefore, in this embodiment, when the content to be reminded is detected, it is necessary to determine the reading immersion level of the user at the current time, and then determine the reminding intensity for the content to be reminded according to the reading immersion level of the user at the current time and the preset correspondence between the reading immersion level and the reminding intensity; and finally, transmitting the content to be reminded to the user according to the determined reminding strength.
Specifically, determining the reading immersion level of the user at the current moment according to the information which is collected in real time and is used for representing whether the electronic equipment is in the mute mode or the vibration inhibiting mode and the information which is used for representing whether the electronic equipment is in the motion state can comprise the following steps:
determining a reading immersion level of a user at a current moment as a first level when the electronic device is currently in a mute mode, in a vibration-disabled mode and not in a motion state;
when the electronic equipment is currently in a mute mode, a vibration inhibiting mode and a motion state, determining that the reading immersion level of the user at the current moment is a second level; the second level is lower than the first level;
when the electronic equipment is in a mute mode and in a motion state, determining that the reading immersion level of the user at the current moment is a third level; the third level is lower than the second level;
when the electronic equipment is not in a mute mode and is in a motion state, determining that the reading immersion level of the user at the current moment is a fourth level; the fourth level is lower than the third level.
In the embodiment, when the electronic device is currently in the mute mode, in the vibration inhibiting mode and in the non-motion state, the situation that the user intentionally wants to create an undisturbed reading environment is shown, the reading immersion degree of the user is the highest, and the reading immersion level of the user at the current moment can be set to be the first highest level.
When the electronic device is currently in a silent mode, not in a vibration-disabled mode, and not in motion, it is said that the user desires a quieter environment, but also allows some disturbance. The user's reading immersion level at the present time may be set to a second higher level.
When the electronic device is currently in the mute mode and in the motion state, the user is indicated to be in motion while reading, and not to put all energy into reading. The user's reading immersion level at the present time may be set to a third level of lower level at this time.
When the electronic device is not in the mute mode and is in the motion state, which indicates that the user is moving while reading and is not repulsive to external disturbance, the reading immersion level of the user at the current moment can be set to the fourth level with the lowest level.
After the reading immersion level of the user at the current moment is determined, the reminding intensity aiming at the content to be reminded can be determined according to the type of the content to be reminded, the reading immersion level of the user at the current moment and the corresponding relation between the preset reading immersion level and the reminding intensity; and then reminding the content to be reminded according to the determined reminding strength.
For example, when the reading immersion level of the user at the current time is the first level:
a-1), if the content to be reminded is a telephone, the corresponding reminding action is reminding in a ring tone + continuous non-beat vibration mode until the user selects to answer the call or presses a home key/presses a screen for cancellation, and the reminding is ensured to be in place.
a-2), if the content to be reminded is the message pushed by the APP, the corresponding reminding action is as follows: and a specific prompt tone and a short high-intensity vibration mode are used for prompting, so that the prompt is ensured to be in place.
a-3), if the content to be reminded is a short message, the corresponding reminding action is as follows: the prompt is given by specific prompt sound plus short and short medium intensity vibration, so that the prompt is ensured to be in place.
When the reading immersion level of the user at the current moment is a second level:
b-1) if the content to be reminded is a telephone, the corresponding reminding action is used as reminding in a continuous non-beat vibration mode until the user selects to answer the phone or presses a home key/presses a screen for cancellation, and the reminding is ensured to be in place.
b-2) if the content to be reminded is the message pushed by the APP, the corresponding reminding action is as follows: after the single character reading is finished, the prompt is carried out in a short and high-intensity vibration mode, and the prompt is ensured to be in place.
b-3), if the content to be reminded is a short message, the corresponding reminding action is as follows: after the single character reading is finished, the single character is prompted to be reminded by vibration with short, medium and moderate intensity, and the reminding is ensured to be in place.
When the reading immersion level of the user at the current moment is the third level or the fourth level, the situation of determining the type of the reminding action is the same, but the reading habits of the user in the two modes are collected respectively so as to improve the user experience. The method specifically comprises the following steps:
c-1) if the content to be reminded is a telephone, the corresponding reminding action is used for reminding in a continuous non-beat vibration mode until the user selects to answer the call or presses a home key/presses a screen for cancellation, and the reminding is ensured to be in place.
c-2), if the content to be reminded is the message pushed by the APP, the corresponding reminding action is as follows: after the current reading process is finished, reminding is carried out in a continuous non-beat vibration mode, the reminding is ensured to be in place, and reading is not influenced.
c-3), if the content to be reminded is a short message, the corresponding reminding action is as follows: and after reading of each chapter and/or quitting the reading mode, reminding the user in a mode of language plus Braille vibration.
The above correspondence is only before the description. In specific application, the method can be adjusted according to actual conditions. The reminding strength corresponding to the message pushed by the APP is higher than that of the telephone.
The above types of the reminding action in different situations are only used for illustration, and the skilled person can set the reminding action according to the actual needs.
The Braille reading method provided by the invention determines the reading immersion grade of a user at the current moment according to the information representing whether the electronic equipment is in a mute mode or a vibration forbidden mode and the information representing whether the electronic equipment is in a motion state, and determines the reminding strength aiming at the content to be reminded according to the reading immersion grade of the user at the current moment and the corresponding relation between the preset reading immersion grade and the reminding strength; the reading experience of the user is not disturbed frequently, the user does not miss important affairs, and good balance is achieved between the two.
Based on any one of the above embodiments, the present embodiment further provides a braille reading method, including:
determining target reading characters from the characters to be read based on the operation of a user;
judging whether the target reading characters are preset common characters or not, and converting the target reading characters into vibration codes when the target reading characters are the preset common characters;
and generating vibration according to the vibration code of the target reading text.
It is well known that the frequency of use of different words varies in daily life. In the present invention, a word whose frequency of use is higher than a preset threshold is referred to as a common word.
In the previous embodiment, the target reading text needs to be converted to six-dot braille and then converted to the vibration code by the six-dot braille. The conversion process has the advantages of wide applicability and capability of realizing conversion of any character; the disadvantage is that the conversion process is relatively complex. The braille reading method described in the previous embodiment is applicable to the case where the target reading of letters is not a common letter.
In this embodiment, for some common words with higher usage frequency, the target reading text with the type of the common word can be converted into the vibration code according to the preset corresponding relationship between the common word and the vibration code.
For example, a vibration code having a format of "-" represents a chinese character "you"; the vibration code in the format of "-" represents the chinese character "i".
The common characters can be Chinese characters, and also can be numbers, foreign letters or foreign words. The correspondence between the common words and the vibration codes can be set according to actual conditions, and is not specifically limited in this embodiment.
The braille reading method provided by the invention is beneficial to improving the reading efficiency of a user by directly mapping the common words into the vibration codes.
Based on any of the above embodiments, fig. 7 is a schematic view of the braille reading device provided by the present invention, and as shown in fig. 7, the braille reading device provided by the present invention includes:
a target reading text determining module 701, configured to determine a target reading text from the text to be read based on an operation of a user;
the vibration code conversion module 702 is configured to convert the target reading text into six-point braille, and convert the six-point braille of the target reading text into a vibration code of the text to be read by using each three-point braille in the six-point braille as a conversion unit;
and the vibration module 703 is configured to generate vibration according to the vibration code of the target reading text.
The Braille reading device provided by the invention takes each three-point Braille in the six-point Braille as a conversion unit, converts one six-point Braille of target reading characters into two independent vibration codes, and can reduce the complexity of the codes and the memory difficulty of a user for a single vibration code, thereby improving the recognition rate and further improving the reading speed; and the vibration coding has better expansibility and more combination possibility, and is convenient to expand common words and common sentence patterns.
Fig. 8 is a schematic physical structure diagram of an electronic device according to the present invention, and as shown in fig. 8, the electronic device may include: a processor (processor)810, a communication Interface 820, a memory 830 and a communication bus 840, wherein the processor 810, the communication Interface 820 and the memory 830 communicate with each other via the communication bus 840. The processor 810 may call logic instructions in the memory 830 to perform the following method:
determining target reading characters from the characters to be read based on the operation of a user;
translating the target reading characters into six-point braille, and converting the six-point braille of the target reading characters into vibration codes of the target reading characters by taking each three-point braille in the six-point braille as a conversion unit;
and generating vibration according to the vibration code of the target reading text.
It should be noted that, when being implemented specifically, the electronic device in this embodiment may be a server, a PC, or other devices, as long as the structure includes the processor 810, the communication interface 820, the memory 830, and the communication bus 840 shown in fig. 8, where the processor 810, the communication interface 820, and the memory 830 complete mutual communication through the communication bus 840, and the processor 810 may call the logic instructions in the memory 830 to execute the above method. The embodiment does not limit the specific implementation form of the electronic device.
In addition, the logic instructions in the memory 830 may be implemented in software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Further, embodiments of the present invention disclose a computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions, which when executed by a computer, the computer is capable of performing the methods provided by the above-mentioned method embodiments, for example, comprising:
determining target reading characters from the characters to be read based on the operation of a user;
translating the target reading characters into six-point braille, and converting the six-point braille of the target reading characters into vibration codes of the target reading characters by taking each three-point braille in the six-point braille as a conversion unit;
and generating vibration according to the vibration code of the target reading text.
In another aspect, an embodiment of the present invention further provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program is implemented by a processor to perform the method provided by the foregoing embodiments, for example, including:
determining target reading characters from the characters to be read based on the operation of a user;
translating the target reading texts into six-point braille alphabets, and converting the six-point braille alphabets of the target reading texts into vibration codes of the target reading texts by taking each three-point braille alphabets in the six-point braille alphabets as a conversion unit;
and generating vibration according to the vibration code of the target reading text.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment may be implemented by software plus a necessary general hardware platform, and may also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (9)

1. A braille reading method is characterized by being applied to electronic equipment, and comprises the following steps:
determining whether the user is in a motion state currently or not according to the motion information acquired in real time based on the operation of the user; when a user is in a motion state at present, increasing the word size of the words to be read and/or the distance between the words to be read when the words to be read are displayed; determining target reading characters from the characters to be read;
translating the target reading characters into six-point braille, and converting the six-point braille of the target reading characters into vibration codes of the target reading characters by taking each three-point braille in the six-point braille as a conversion unit;
and when the user is in a motion state at present, generating vibration according to the vibration code of the target reading text and the preset high vibration strength.
2. A braille reading method according to claim 1, characterized in that before the determination of the target reading text from the text to be read, the method further comprises:
counting the number of times that the characters to be read are selected in a preset time period;
when the selected times of the characters to be read in a preset time period exceed a preset time threshold, executing at least one of the following operations: increasing the word size of the words to be read when the words to be read are displayed and increasing the distance between the words to be read;
the generating vibration according to the vibration code of the target reading text comprises:
and when the selected times of the characters to be read in a preset time period exceed a preset time threshold, generating vibration according to the vibration code of the target reading characters and the preset high vibration strength.
3. A braille reading method according to claim 1, characterized in that before the determination of the target reading text from the text to be read, the method further comprises:
counting the accuracy of the operation of the user in a preset time period;
and when the accuracy is lower than a preset accuracy threshold, adjusting the display parameters of the characters to be read when the characters to be read are displayed.
4. A braille reading method according to claim 1, characterized in that after the generation of the vibrations according to the vibration coding of the target read letter, the method further comprises:
detecting whether the content to be reminded exists at present; the content to be reminded is the content needing to remind the user of paying attention;
when the content to be reminded is detected, determining the reading immersion level of the user at the current moment according to information which is collected in real time and used for representing whether the electronic equipment is in a mute mode or a vibration inhibiting mode and information which is used for representing whether the electronic equipment is in a motion state;
determining the reminding intensity aiming at the content to be reminded according to the reading immersion level of the user at the current moment and the corresponding relation between the preset reading immersion level and the reminding intensity;
and reminding the content to be reminded according to the determined reminding strength.
5. A braille reading method according to claim 4, characterized in that the determination of the reading immersion level of the user at the present moment based on the information characterizing whether the electronic device is in the silent mode, the vibration disabled mode and the information characterizing whether the electronic device is in the motion state, which are collected in real time, comprises:
determining a reading immersion level of a user at a current moment as a first level when the electronic device is currently in a mute mode, in a vibration-disabled mode and not in a motion state;
when the electronic equipment is currently in a mute mode, a vibration inhibiting mode and a motion state, determining that the reading immersion level of the user at the current moment is a second level; the second level is lower than the first level;
when the electronic equipment is in a mute mode and in a motion state, determining that the reading immersion level of the user at the current moment is a third level; the third level is lower than the second level;
when the electronic equipment is not in a mute mode and is in a motion state, determining that the reading immersion level of the user at the current moment is a fourth level; the fourth level is lower than the third level.
6. A braille reading method according to claim 4, characterized in that the determining of the strength of the reminder for the content to be reminded in accordance with the reading immersion level of the user at the current time and the correspondence between the preset reading immersion level and the strength of the reminder comprises:
and determining the reminding intensity aiming at the content to be reminded according to the type of the content to be reminded, the reading immersion level of the user at the current moment, the corresponding relation between the preset reading immersion level and the reminding intensity and the corresponding relation between the preset type of the content to be reminded and the reminding intensity.
7. A braille reading device, comprising:
the target reading character determining module is used for determining whether the user is in a motion state currently or not according to the motion information acquired in real time based on the operation of the user; when a user is in a motion state at present, increasing the word size of the words to be read and/or the distance between the words to be read when the words to be read are displayed; determining target reading characters from the characters to be read;
the vibration code conversion module is used for converting the target reading texts into six-point braille alphabets and converting the six-point braille alphabets of the target reading texts into vibration codes of the texts to be read by taking each three-point braille alphabets in the six-point braille alphabets as a conversion unit;
and the vibration module is used for generating vibration according to the vibration code of the target reading text and the preset high vibration strength when the user is in a motion state at present.
8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the braille reading method according to any one of the claims 1 to 6 are realized when the program is executed by the processor.
9. A non-transitory computer readable storage medium having stored thereon a computer program, characterized in that the computer program, when being executed by a processor, realizes the steps of the braille reading method according to any of the claims 1 to 6.
CN202110518911.3A 2021-05-12 2021-05-12 Braille reading method, electronic device and storage medium Active CN113160666B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110518911.3A CN113160666B (en) 2021-05-12 2021-05-12 Braille reading method, electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110518911.3A CN113160666B (en) 2021-05-12 2021-05-12 Braille reading method, electronic device and storage medium

Publications (2)

Publication Number Publication Date
CN113160666A CN113160666A (en) 2021-07-23
CN113160666B true CN113160666B (en) 2022-08-30

Family

ID=76875157

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110518911.3A Active CN113160666B (en) 2021-05-12 2021-05-12 Braille reading method, electronic device and storage medium

Country Status (1)

Country Link
CN (1) CN113160666B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114740981B (en) * 2022-04-25 2023-06-30 腾讯科技(深圳)有限公司 Information processing method, information processing apparatus, readable medium, electronic device, and program product
CN115277933B (en) * 2022-07-15 2023-09-19 咪咕数字传媒有限公司 Vibration reminding method, device, equipment and storage medium

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100578568C (en) * 2005-09-21 2010-01-06 东南大学 Touch visual-text display device based on jet technique and its display method
CN103514784B (en) * 2012-06-21 2016-03-09 国基电子(上海)有限公司 The method of electronic equipment and helping blind people read thereof
US10048835B2 (en) * 2014-10-31 2018-08-14 Microsoft Technology Licensing, Llc User interface functionality for facilitating interaction between users and their environments
CN106097834B (en) * 2016-05-20 2020-07-24 苏州万硅电子有限公司 Braille reader
US10607506B2 (en) * 2016-10-05 2020-03-31 International Business Machines Corporation Braille reading using fingerprint scanner and varying vibration frequencies
KR101848184B1 (en) * 2016-12-28 2018-04-11 고려대학교 산학협력단 Vibration-type braille system And Method for implementing Vibration-type braille based on touch screen
CN112185194A (en) * 2020-11-03 2021-01-05 广西艺术学院 Talking book for children

Also Published As

Publication number Publication date
CN113160666A (en) 2021-07-23

Similar Documents

Publication Publication Date Title
US10789959B2 (en) Training speaker recognition models for digital assistants
US11170166B2 (en) Neural typographical error modeling via generative adversarial networks
US10466890B2 (en) Quick gesture input
CN108537207B (en) Lip language identification method, device, storage medium and mobile terminal
CN113160666B (en) Braille reading method, electronic device and storage medium
CN111106995B (en) Message display method, device, terminal and computer readable storage medium
JP2017220210A (en) Dynamic phrase expansion of language input
CN102375656B (en) Full spelling single character sliding input method based on touch screen, device and touch screen terminal
EP3586332A1 (en) Multi-modal interaction between users, automated assistants, and other computing services
EP3635513B1 (en) Selective detection of visual cues for automated assistants
CN107707454A (en) Information processing method and device based on instant messaging or social application
CN109166409B (en) Sign language conversion method and device
Shokat et al. Analysis and evaluation of braille to text conversion methods
CN114740981A (en) Information processing method, information processing apparatus, readable medium, electronic device, and program product
JP2023532395A (en) Suggesting alternative interfaces when environmental interference is predicted to interfere with specific interactions of automated assistants
WO2017176513A1 (en) Generating and rendering inflected text
CN107797676B (en) Single character input method and device
CN112652304B (en) Voice interaction method and device of intelligent equipment and electronic equipment
CN106980640B (en) Interaction method, device and computer-readable storage medium for photos
CN108132717A (en) Recommendation method, apparatus, storage medium and the mobile terminal of candidate word
JP2016091282A (en) Electronic apparatus and operation mode switching program
US11183167B2 (en) Determining an output position of a subject in a notification based on attention acquisition difficulty
Wang et al. Research and implementation of blind reader system based on android platform
Brown et al. “… Language in Their Very Gesture” First Steps towards Calm Smart Home Input
US20230386469A1 (en) Detecting visual attention during user speech

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant