CN112684936A - Information identification method, storage medium and computer equipment - Google Patents
Information identification method, storage medium and computer equipment Download PDFInfo
- Publication number
- CN112684936A CN112684936A CN202011610970.5A CN202011610970A CN112684936A CN 112684936 A CN112684936 A CN 112684936A CN 202011610970 A CN202011610970 A CN 202011610970A CN 112684936 A CN112684936 A CN 112684936A
- Authority
- CN
- China
- Prior art keywords
- touch
- determining
- touch operation
- text information
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000008447 perception Effects 0.000 claims description 36
- 230000035945 sensitivity Effects 0.000 claims description 18
- 238000012545 processing Methods 0.000 claims description 10
- 230000011218 segmentation Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 17
- 230000006870 function Effects 0.000 description 14
- 238000001514 detection method Methods 0.000 description 6
- 241001672694 Citrus reticulata Species 0.000 description 3
- 238000013459 approach Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- MQJKPEGWNLWLTK-UHFFFAOYSA-N Dapsone Chemical compound C1=CC(N)=CC=C1S(=O)(=O)C1=CC=C(N)C=C1 MQJKPEGWNLWLTK-UHFFFAOYSA-N 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000012946 outsourcing Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000013179 statistical model Methods 0.000 description 1
- 230000026676 system process Effects 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses an information identification method, a storage medium and computer equipment, wherein the method comprises the following steps: determining that a touch operation aiming at a touch screen is detected, and identifying a touch position corresponding to the touch operation; identifying a control at the touch position, and determining text information contained in the control; and broadcasting the text information by voice. By the adoption of the method and the device, the text information displayed in the designated area can be broadcasted in a voice mode, users who do not know words can be helped to effectively understand, and the users can use the terminal equipment.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to an information identification method, a storage medium, and an apparatus.
Background
With the rapid development of computer technology, mobile phones, computers and other terminal devices have become an essential part of people's daily life. There is a group of people who have no learning experience, do not recognize characters, and do not speak mandarin, but the internet and multimedia times come, often watch television, listen to radio, etc., and can understand mandarin.
The people do not know characters, so that the people are very inconvenient to use the terminal equipment, can not speak Mandarin, and can not realize the operation of the intelligent equipment through the voice assistant. They cannot effectively understand when they need to view the text information displayed on the terminal device.
Disclosure of Invention
The embodiment of the application provides an information identification method, a storage medium and equipment, which can be used for broadcasting text information displayed in a designated area in a voice mode, helping users who do not know words effectively understand and ensuring the use of the users to terminal equipment.
In a first aspect, an embodiment of the present application provides an information identification method, which is applied to a terminal device, and the method includes:
determining that a touch operation for the touch screen is detected;
identifying a touch position corresponding to the touch operation;
identifying a control at the touch position, and determining text information contained in the control;
and broadcasting the text information by voice.
In a second aspect, an embodiment of the present application provides an information identification apparatus, including:
the touch operation determining module is used for determining that the touch operation aiming at the touch screen is detected;
the position identification module is used for identifying a touch position corresponding to the touch operation;
the information identification module is used for identifying the control at the touch position and determining text information contained in the control;
and the voice broadcasting module is used for voice broadcasting the text information.
In a third aspect, embodiments of the present application provide a computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the steps of the above method.
In a fourth aspect, an embodiment of the present application provides a computer device, including: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the steps of the above-mentioned method.
In this application embodiment, when detecting the touch operation to the touch-sensitive screen, discernment the touch position that touch operation corresponds, and then discernment the controlling part that the touch position corresponds, and then discernment text messaging, the voice broadcast that contain in the controlling part text messaging has realized the voice broadcast of the text messaging that shows in the region appointed to the user, and the user that helps not know the word and the user that needs this function effectively understand text messaging.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of an information identification method according to an embodiment of the present application;
fig. 2 is a schematic flowchart of an information identification method according to an embodiment of the present application;
fig. 3 is a schematic flowchart of an information identification method according to an embodiment of the present application;
FIG. 4 is an exemplary diagram illustrating a contact coordinate determination provided by an embodiment of the present application;
FIG. 5 is an exemplary diagram of a non-contact touch provided by an embodiment of the present application;
FIG. 6 is an exemplary diagram of a touch provided by an embodiment of the present application;
fig. 7 is a schematic structural diagram of an information identification apparatus according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of an information identification apparatus according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a touch operation determination module according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a duration obtaining module according to an embodiment of the present application;
fig. 11 is a schematic structural diagram of a location identification module according to an embodiment of the present application;
fig. 12 is a schematic structural diagram of a voice broadcast module provided in an embodiment of the present application;
fig. 13 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The information identification method provided by the embodiment of the application can be applied to the terminal equipment, and can realize voice broadcast of the information in the terminal equipment. The terminal device can include, but is not limited to, a mobile phone, a personal computer, smart furniture, a vehicle-mounted device, a wearable device and other terminal devices with a terminal touch display function. The information recognition device is a core device for information recognition, and the information recognition device may be a system process running in a terminal system of a terminal device, or may be an information recognition device that is independent of the terminal device and is reliably connected with the terminal device, and is mainly used for voice broadcasting of information displayed by the terminal device, and the information recognition device may be configured in the terminal system when the terminal device leaves a factory, or may be installed in the terminal device by a user. The terminal system may specifically be an operating system configured in the terminal device, for example: android systems, Windows systems, IOS systems, hongmeng systems, etc. The information to be identified is mainly information displayed in the process of realizing some functions or realized some functions by the terminal equipment and other applications in the terminal equipment. The other applications may be system applications or third-party applications, and the system applications may specifically be terminal applications installed by default when the terminal device leaves a factory, for example: the third-party application is a terminal application obtained by a user from a third-party server based on terminal equipment, such as: instant messaging applications, gaming applications, shopping applications, and the like.
The information identification method provided by the embodiment of the present application will be described in detail below with reference to fig. 1 to 6.
Referring to fig. 1, a flow chart of an information identification method is provided in an embodiment of the present application. As shown in fig. 1, the method may include the following steps S101 to S104.
S101, determining that a touch operation aiming at a touch screen is detected;
specifically, it is determined that a touch operation for the touch screen is detected, and the touch operation for the touch screen may be a non-contact touch or a contact touch. Whether the touch operation on the touch screen is performed or not is detected in real time or periodically, and the following steps S102 to S104 can be continued only when the touch operation on the touch screen is detected.
It will be appreciated that the nature of a touch screen is a sensor, which is comprised of a touch sensitive component and a touch screen controller. When a user performs a touch operation, a touch sensing parameter of the touch screen changes. Based on the change situation of the touch perception parameters, whether touch operation is performed on the touch screen or not can be judged. And if the touch perception parameters are changed, judging that the touch operation aiming at the touch screen exists, and if the touch perception parameters are not changed, judging that the touch operation aiming at the touch screen does not exist.
The touch screen may be a capacitive touch screen and the touch sensing parameter may be a contact capacitance value.
S102, identifying a touch position corresponding to the touch operation;
specifically, the step of identifying the touch position corresponding to the touch operation mainly means that when a human hand performs the touch operation on the touch screen, a touch detection part of the touch screen detects a touch perception parameter change area corresponding to the human hand, and transmits information of the detected touch perception parameter change area to a touch screen controller, and the touch screen controller reads the information of the touch perception parameter change area, identifies a contact coordinate, and then determines the contact coordinate as the touch position.
It is understood that the touch sensing parameter variation area is a part of the area on the touch screen, which has no specific shape and area, so the contact point coordinates are identified differently. For example:
one possible identification approach 1: and making a minimum coverage circle of the touch perception change area, and identifying the circle center of the minimum coverage circle as a contact point coordinate.
One possible identification approach 2: and making a maximum inscribed circle of the touch perception change area, and identifying the circle center of the maximum inscribed circle as a contact point coordinate and other identification modes.
Please refer to fig. 4, as shown in fig. 4. The above identification method 1: when a human hand touches the touch screen, a touch detection part of the touch screen detects a touch perception parameter change area 1 and transmits the touch perception parameter change area information to a touch screen controller, and the touch screen controller identifies the center M point coordinate of the smallest coverage circle of the touch perception change area and determines the M point coordinate as a touch position. The above recognition method 2: when a human hand touches the touch screen, a touch detection part of the touch screen detects a touch perception parameter change area 2 and transmits the touch perception parameter change area information to a touch screen controller, and the touch screen controller identifies the coordinates of the N points of the circle center of the maximum inscribed circle of the touch perception change area and determines the coordinates of the N points as touch positions.
The specific identification manner can be set according to the usage habit and the actual requirement, which is not described herein.
S103, identifying a control at the touch position, and determining text information contained in the control;
specifically, a control at the touch position is identified, and text information contained in the control is determined, where the control at the touch position mainly refers to a carrier of the text information displayed on the current display interface, for example: text boxes, icons with textual information, buttons with textual information, search boxes, and the like. And accurately acquiring the identification area according to the control. And the step of determining the text information contained in the control mainly refers to identifying the text information or keywords displayed in the control area.
And S104, broadcasting the text information by voice.
Specifically, the recognized text information or keywords are broadcasted by the speech synthesis system.
Optionally, the text information or the keyword may be synthesized into the broadcast by selecting a desired basic unit from a voice packet, where the basic unit may be a syllable, a phoneme, a diphone, or the like, for example, if the text information includes the following text: "the weather is cloudy and clear today, the air temperature is 20 ℃, then the following resolution can be performed: "today", "day", "weather", "cloudy and sunny", "air temperature", "20" and "degree centigrade", the basic units of the corresponding words are called in the voice packet to be spliced and synthesized into the voice. The text information or the keywords can also be used for generating speech parameters at every moment through a statistical model and then converting the speech parameters into language waveforms.
In this application embodiment, when detecting the touch operation to the touch-sensitive screen, discernment the touch position that touch operation corresponds, and then discernment the controlling part that the touch position corresponds, and then discernment text messaging, the voice broadcast that contain in the controlling part text messaging has realized the voice broadcast of the text messaging that shows in the region appointed to the user, and the user that helps not know the word and the user that needs this function effectively understand text messaging.
Referring to fig. 2, a flow chart of an information identification method according to an embodiment of the present application is schematically shown. As shown in fig. 2, the method may include the following steps S201 to S211.
S201, increasing the perception sensitivity of the touch screen;
specifically, when a user is about to perform a touch operation, the system thermal sensing module senses the approach of a human hand, and the system automatically adjusts the sensing sensitivity of the touch screen. And setting a distance threshold value between the finger and the screen based on the fact that the thermal sensing module senses the distance between the finger and the screen. If the actual distance between the finger and the screen exceeds a set threshold, no touch behavior is judged, if the actual distance between the finger and the screen is smaller than the set threshold, the screen perception sensitivity is adjusted according to the distance between the finger and the screen, the screen perception sensitivity is in direct proportion to the distance between the finger and the screen, the farther the distance between the finger and the screen is, the higher the screen perception sensitivity is, and the closer the distance between the finger and the screen is, the lower the screen perception sensitivity is. The actual value of the screen perception sensitivity is based on the fact that the touch screen can correctly sense the touch operation within the distance threshold range, and the specific sensitivity value is set automatically according to the hardware level of the touch screen.
S202, detecting that the touch sensing parameters of the touch screen change, and determining a change area corresponding to the touch sensing parameters;
specifically, the touch detection component of the touch screen can be divided into a plurality of small touch sensing units. When a human hand touches the touch screen, the touch sensing parameters of the touch sensing units change, the change area is determined according to the area where the touch sensing unit with the changed touch sensing parameters is located, and the area of the change area is calculated. The area of the change area can be calculated according to the number of the touch sensing units with the changed touch sensing parameters, and the area of the change area is equal to the number of the touch sensing units with the changed touch sensing parameters multiplied by the area of a single touch sensing unit.
S203, if the area of the change area is smaller than or equal to a preset area, determining that the non-contact touch operation aiming at the touch screen is detected;
specifically, a preset area is predefined in the terminal system, and the size of the preset area is set according to actual use experience and use requirements.
And if the area of the change area is smaller than or equal to the touch operation of the preset area, judging the non-contact touch operation. The non-contact operation is a touch mode that a finger is away from a screen by a certain distance.
Referring to fig. 5, as shown in fig. 5, the finger is hovering above the touch screen at a certain distance from the touch screen to perform the non-contact touch operation.
S204, acquiring the duration of the touch operation;
specifically, timing is started from the time when the touch sensing parameter is detected to be changed, and timing is stopped when the touch sensing parameter is recovered to be normal, wherein the time period is the duration of the touch operation.
S205, if the duration is less than or equal to the preset duration, determining that the operation is misoperation;
specifically, a preset time length is predefined in the terminal system, and the size of the preset time length is set according to actual use experience and use requirements.
And if the duration is less than or equal to the preset duration, determining the operation is a misoperation, and not performing the following steps. The method can effectively avoid the false touch caused by the fact that the finger scratches the screen and the like, greatly improves the accuracy of touch recognition, and further improves the accuracy of information recognition.
S206, if the duration is longer than the preset duration, determining an area covered by the touch operation, and determining a contact point coordinate of the area;
specifically, if the duration is longer than the preset duration, the touch detection device of the touch screen transmits the position information of the detected touch sensing parameter change area to the touch screen controller, the touch screen controller converts the touch information received from the touch detection device into a contact coordinate, and the contact coordinate provided by this embodiment is the center of an outsourcing circle of the touch sensing parameter change area.
S207, determining the position indicated by the central point coordinate as a touch position;
specifically, the position indicated by the touch point coordinate is determined as a touch position, and the touch screen controller transmits the touch point coordinate to the processor.
S208, identifying a control at the touch position, and determining text information contained in the control;
specifically, a control at the touch position is identified, and text information contained in the control is determined, where the control at the touch position mainly refers to a carrier of the text information displayed on the current display interface, for example: text boxes, icons with textual information, buttons with textual information, search boxes, and the like. And accurately acquiring the identification area according to the control. And the step of determining the text information contained in the control mainly refers to identifying all the text information displayed in the control area.
S209, carrying out segmentation processing on the text information;
specifically, the text information identified is segmented, and text features are extracted, including sentence break, word segmentation, polyphone and numeric processing on a long text sentence. Illustratively, if the text information contains the following text: "the weather is cloudy and clear today, the air temperature is 20 ℃, then the following resolution can be performed: today, day, weather, cloudy and sunny, temperature, 20 and degree centigrade.
S210, calling a voice packet to synthesize the text information subjected to the segmentation processing into a language waveform;
specifically, the individual characters, words, numbers, etc. corresponding to the segmented text information are extracted from the voice packet to obtain the corresponding individual character syllables, phonemes, or phrase diphones, etc. and synthesized into the language waveform.
And S211, converting the language waveform into sound waves and outputting the sound waves.
Specifically, the terminal device processor transmits the synthesized speech waveform to a speaker, and the speaker is responsible for converting the synthesized speech waveform into sound waves to be output.
In the embodiment of the application, when the touch operation aiming at the touch screen is detected, the touch position corresponding to the touch operation is identified, the control corresponding to the touch position is further identified, the text information contained in the control is further identified, the text information is broadcasted in a voice mode, the voice broadcast of the text information displayed in the area appointed by the user is realized, and the users who do not know words and the users needing the function can effectively understand the text information; by increasing the perception sensitivity of the touch screen, the screen can sense the non-contact touch of a user, and the use of an information identification function is ensured; by comparing the touch duration with the preset duration, misoperation touch with the touch duration less than or equal to the preset duration can be filtered out, and the touch operation accuracy is improved; by identifying the control at the touch position, the text information in the control area is further determined, and the accuracy of text information identification is improved.
Referring to fig. 3, a flow chart of an information identification method is provided in the embodiment of the present application. As shown in fig. 3, the method may include steps S301 to S311.
S301, increasing the perception sensitivity of the touch screen;
s302, detecting that the touch sensing parameters of the touch screen change, and determining a change area corresponding to the touch sensing parameters;
the steps S301 to S302 may specifically refer to the steps S201 to S202, and are not described herein again.
S303, if the area of the change area is larger than a preset area, determining that the contact type touch operation aiming at the touch screen is detected;
specifically, a preset area is predefined in the terminal system, and the size of the preset area is set according to actual use experience and use requirements.
And if the area of the change area is larger than the touch operation of the preset area, judging the touch operation as the contact type touch operation. The touch operation is that the finger is at zero distance from the screen.
Referring to fig. 6, as shown in fig. 6, the finger is at a distance of zero from the touch screen, and the finger is in direct contact with the touch screen to perform the contact touch operation.
S304, acquiring the duration of the touch operation; s305, if the duration is less than or equal to the preset duration, determining that the operation is misoperation;
s306, if the duration is longer than the preset duration, determining an area covered by the touch operation, and determining the contact coordinates of the area;
s307, determining the position indicated by the central point coordinate as a touch position;
s308, identifying a control at the touch position, and determining text information contained in the control;
s309, carrying out segmentation processing on the text information;
s310, calling a voice packet to synthesize the text information subjected to the segmentation processing into a language waveform;
and S311, converting the language waveform into sound waves to be output.
For the detailed description of the steps S304 to S311, refer to the steps S204 to S211, which are not described herein again.
In the embodiment of the application, when the touch operation aiming at the touch screen is detected, the touch position corresponding to the touch operation is identified, the control corresponding to the touch position is further identified, the text information contained in the control is further identified, the text information is broadcasted in a voice mode, the voice broadcast of the text information displayed in the area appointed by the user is realized, and the users who do not know words and the users needing the function can effectively understand the text information; by increasing the perception sensitivity of the touch screen, the screen can sense the non-contact touch of a user, and the use of an information identification function is ensured; by comparing the touch duration with the preset duration, misoperation touch with the touch duration less than or equal to the preset duration can be filtered out, and the touch operation accuracy is improved; by identifying the control at the touch position, the text information in the control area is further determined, and the accuracy of text information identification is improved.
Based on the system architecture shown in fig. 1, the information recognition apparatus provided in the embodiment of the present application will be described in detail below with reference to fig. 7 to 12. It should be noted that, the information identification apparatus in fig. 7 to 12 is used for executing the method of the embodiment shown in fig. 1 to 6 of the present application, and for convenience of description, only the portion related to the embodiment of the present application is shown, and details of the specific technology are not disclosed, please refer to the embodiment shown in fig. 1 to 6 of the present application.
Fig. 7 is a schematic structural diagram of an information recognition apparatus according to an embodiment of the present disclosure. As shown in fig. 7, the information recognition apparatus 1 according to the embodiment of the present application may include: the system comprises a touch operation determination module 101, a position recognition module 102, an information recognition module 103 and a voice broadcast module 104.
A touch operation determination module 101, configured to determine that a touch operation for a touch screen is detected;
a position identification module 102, configured to identify a touch position corresponding to the touch operation;
the information identification module 103 is used for identifying a control at the touch position and determining text information contained in the control;
and the voice broadcasting module 104 is used for voice broadcasting the text information.
In this application embodiment, when detecting the touch operation to the touch-sensitive screen, discernment the touch position that touch operation corresponds, and then discernment the controlling part that the touch position corresponds, and then discernment text messaging, the voice broadcast that contain in the controlling part text messaging has realized the voice broadcast of the text messaging that shows in the region appointed to the user, and the user that helps not know the word and the user that needs this function effectively understand text messaging.
Please refer to fig. 8, which is a schematic structural diagram of an information recognition apparatus according to an embodiment of the present application. As shown in fig. 8, the information recognition apparatus 1 according to the embodiment of the present application may include: the system comprises a sensitivity adjusting module 105, a touch operation determining module 101, a duration obtaining module 106, a position identifying module 102, an information identifying module 103 and a voice broadcasting module 104.
The sensitivity adjusting module 105 is used for increasing the perception sensitivity of the touch screen;
a touch operation determination module 101, configured to determine that a touch operation for a touch screen is detected;
specifically, please refer to fig. 9, which provides a schematic structural diagram of a touch operation determining module according to an embodiment of the present application. As shown in fig. 9, the touch operation determination module 101 may include:
the area determining unit 111 is configured to determine a change area corresponding to a touch sensing parameter when the touch sensing parameter of the touch screen is detected to change;
a touch manner determining unit 112, configured to determine a touch manner of the touch operation.
The duration obtaining module 106 is configured to obtain a duration of the touch operation, and determine a misoperation;
specifically, please refer to fig. 10, which provides a schematic structural diagram of a duration obtaining module according to an embodiment of the present application. As shown in fig. 10, the duration obtaining module 106 may include:
a duration obtaining unit 121, configured to obtain a duration of the touch operation;
the misoperation determining unit 122 is configured to execute the step of identifying the touch position corresponding to the touch operation if the duration is greater than a preset duration; or
The misoperation determining unit 122 is configured to determine that the operation is a misoperation if the duration is less than or equal to the preset duration.
A position identification module 102, configured to identify a touch position corresponding to the touch operation;
specifically, please refer to fig. 11, which provides a schematic structural diagram of a location identification module according to an embodiment of the present application. As shown in fig. 11, the location identification module 102 may include:
a coordinate determination unit 131, configured to determine an area covered by the touch operation, and determine a center point coordinate of the area;
and a position determining unit 132 for determining the position indicated by the center point coordinates as a touch position.
The information identification module 103 is used for identifying a control at the touch position and determining text information contained in the control;
the voice broadcasting module 104 is used for broadcasting the text information in a voice mode;
specifically, please refer to fig. 12 together, which provides a schematic structural diagram of a voice broadcast module according to an embodiment of the present application. As shown in fig. 12, the voice broadcast module 104 may include:
an information processing unit 141 configured to perform segmentation processing on the text information;
a speech synthesis unit 142, configured to invoke a speech packet to synthesize the segmented text information into a speech waveform;
and a voice output unit 143 that converts the speech waveform into a sound wave for output.
In the embodiment of the application, when the touch operation aiming at the touch screen is detected, the touch position corresponding to the touch operation is identified, the control corresponding to the touch position is further identified, the text information contained in the control is further identified, the text information is broadcasted in a voice mode, the voice broadcast of the text information displayed in the area appointed by the user is realized, and the users who do not know words and the users needing the function can effectively understand the text information; by increasing the perception sensitivity of the touch screen, the screen can sense the non-contact touch of a user, and the use of an information identification function is ensured; by comparing the touch duration with the preset duration, misoperation touch with the touch duration less than or equal to the preset duration can be filtered out, and the touch operation accuracy is improved; by identifying the control at the touch position, the text information in the control area is further determined, and the accuracy of text information identification is improved.
The embodiment of the present application further provides a computer storage medium, where the computer storage medium may store a plurality of program instructions, where the program instructions are suitable for being loaded by a processor and executing the method steps in the embodiments shown in fig. 1 to 6, and a specific execution process may refer to specific descriptions of the embodiments shown in fig. 1 to 6, which is not described herein again.
Referring to fig. 13, a schematic structural diagram of a computer device is provided in an embodiment of the present application. As shown in fig. 13, the computer apparatus 1000 may include: at least one processor 1001, such as a CPU, at least one touch screen 1004, speakers 1005, memory 1006, at least one communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. Where the touch screen 1004 may be a capacitive touch screen. The memory 1006 may be a high-speed RAM memory or a non-volatile memory (e.g., at least one disk memory). The memory 1006 may optionally be at least one storage device located remotely from the processor 1001. As shown in fig. 12, the memory 1006, which is a kind of computer storage medium, may include therein an operating system, a peripheral module, a touch operation determination module, a position recognition module, an information recognition module, and a voice broadcast module.
In one embodiment.
The processor 1001 may be configured to call the touch operation determination module, the position recognition module, the information recognition module, and the voice broadcast module stored in the memory 1006, and specifically perform the following operations:
determining that a touch operation for the touch screen is detected;
identifying a touch position corresponding to the touch operation;
identifying a control at the touch position, and determining text information contained in the control;
and broadcasting the text information by voice.
Optionally, before determining that the touch operation on the touch screen is detected, the processor 1001 further performs the following operations:
and increasing the perception sensitivity of the touch screen.
Optionally, when determining that the touch operation on the touch screen is detected, the processor 1001 specifically performs the following operations:
when detecting that the touch perception parameters of the touch screen change, determining a change area corresponding to the touch perception parameters;
and if the area of the change area is smaller than or equal to the preset area, determining that the non-contact touch operation aiming at the touch screen is detected.
When detecting that the touch perception parameters of the touch screen change, determining a change area corresponding to the touch perception parameters;
and if the area of the change area is larger than the preset area, determining that the contact type touch operation aiming at the touch screen is detected.
Optionally, before the processor 1001 identifies the touch position corresponding to the touch operation, the following operations are further performed:
acquiring the duration of the touch operation;
if the duration is longer than the preset duration, executing a step of identifying a touch position corresponding to the touch operation;
and if the duration is less than or equal to the preset duration, determining the misoperation.
Optionally, when the processor 1001 identifies the touch position corresponding to the touch operation, the following operation is specifically performed:
determining an area covered by the touch operation, and determining the coordinates of the center point of the area;
and determining the position indicated by the central point coordinate as a touch position.
Optionally, when the processor 1001 executes the voice broadcast of the text information, the following operations are specifically executed:
carrying out segmentation processing on the text information;
calling a voice packet to synthesize the text information subjected to the segmentation processing into a language waveform;
and converting the language waveform into sound wave output.
In the embodiment of the application, when the touch operation aiming at the touch screen is detected, the touch position corresponding to the touch operation is identified, the control corresponding to the touch position is further identified, the text information contained in the control is further identified, the text information is broadcasted in a voice mode, the voice broadcast of the text information displayed in the area appointed by the user is realized, and the users who do not know words and the users needing the function can effectively understand the text information; by increasing the perception sensitivity of the touch screen, the screen can sense the non-contact touch of a user, and the use of an information identification function is ensured; by comparing the touch duration with the preset duration, misoperation touch with the touch duration less than or equal to the preset duration can be filtered out, and the touch operation accuracy is improved; by identifying the control at the touch position, the text information in the control area is further determined, and the accuracy of text information identification is improved.
An embodiment of the present application further provides a computer storage medium, where the computer storage medium may store a plurality of program instructions, where the program instructions are suitable for being loaded by a processor and executing the method steps in the embodiments shown in fig. 1 to 13, and a specific execution process may refer to specific descriptions of the embodiments shown in fig. 1 to 13, which is not described herein again.
It should be noted that, for the sake of simplicity, the above-mentioned method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present application is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In view of the above, it is an object of the present invention to provide an information identifying method, a storage medium and a computer device, which are capable of being applied to a computer system, and a computer program product.
Claims (10)
1. An information identification method is applied to a terminal device, and the method comprises the following steps:
determining that a touch operation for the touch screen is detected;
identifying a touch position corresponding to the touch operation;
identifying a control at the touch position, and determining text information contained in the control;
and broadcasting the text information by voice.
2. The information recognition method according to claim 1, wherein before the determining that the touch operation for the touch screen is detected, the method further comprises:
and increasing the perception sensitivity of the touch screen.
3. The information recognition method according to claim 1, wherein the determining that the touch operation for the touch screen is detected includes:
when detecting that the touch perception parameters of the touch screen change, determining a change area corresponding to the touch perception parameters;
and if the area of the change area is smaller than or equal to the preset area, determining that the non-contact touch operation aiming at the touch screen is detected.
4. The information recognition method according to claim 1, wherein the determining that the touch operation for the touch screen is detected includes:
when detecting that the touch perception parameters of the touch screen change, determining a change area corresponding to the touch perception parameters;
and if the area of the change area is larger than the preset area, determining that the contact type touch operation aiming at the touch screen is detected.
5. The information identification method according to claim 1, wherein before identifying the touch position corresponding to the touch operation, the method further comprises:
acquiring the duration of the touch operation;
if the duration is longer than the preset duration, executing a step of identifying a touch position corresponding to the touch operation;
and if the duration is less than or equal to the preset duration, determining the misoperation.
6. The information identification method according to claim 1, wherein the identifying the touch position corresponding to the touch operation includes:
determining an area covered by the touch operation, and determining the coordinates of the center point of the area;
and determining the position indicated by the central point coordinate as a touch position.
7. The information recognition method of claim 1, wherein the voice broadcasting the text information comprises:
carrying out segmentation processing on the text information;
calling a voice packet to synthesize the text information subjected to the segmentation processing into a language waveform;
and converting the language waveform into sound wave output.
8. An information identifying apparatus, comprising:
the touch operation determining module is used for determining that the touch operation aiming at the touch screen is detected;
the position identification module is used for identifying a touch position corresponding to the touch operation;
the information identification module is used for identifying the control at the touch position and determining text information contained in the control;
and the voice broadcasting module is used for voice broadcasting the text information.
9. A computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the steps of the method according to any of claims 1 to 7.
10. A computer device, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the steps of the method according to any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011610970.5A CN112684936A (en) | 2020-12-29 | 2020-12-29 | Information identification method, storage medium and computer equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011610970.5A CN112684936A (en) | 2020-12-29 | 2020-12-29 | Information identification method, storage medium and computer equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112684936A true CN112684936A (en) | 2021-04-20 |
Family
ID=75455112
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011610970.5A Withdrawn CN112684936A (en) | 2020-12-29 | 2020-12-29 | Information identification method, storage medium and computer equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112684936A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113778255A (en) * | 2021-07-29 | 2021-12-10 | 荣耀终端有限公司 | Touch recognition method and device |
| CN113885768A (en) * | 2021-10-19 | 2022-01-04 | 清华大学 | Auxiliary reading control method and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130063494A1 (en) * | 2011-09-12 | 2013-03-14 | Microsoft Corporation | Assistive reading interface |
| CN104571917A (en) * | 2015-01-23 | 2015-04-29 | 广东能龙教育股份有限公司 | Reading method and system based on touch screen |
| CN106293034A (en) * | 2015-06-11 | 2017-01-04 | 中兴通讯股份有限公司 | The method of a kind of information output and terminal |
| CN106855784A (en) * | 2016-12-16 | 2017-06-16 | 广东欧珀移动通信有限公司 | Prevent method, device and the terminal of touch key-press false triggering |
-
2020
- 2020-12-29 CN CN202011610970.5A patent/CN112684936A/en not_active Withdrawn
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130063494A1 (en) * | 2011-09-12 | 2013-03-14 | Microsoft Corporation | Assistive reading interface |
| CN104571917A (en) * | 2015-01-23 | 2015-04-29 | 广东能龙教育股份有限公司 | Reading method and system based on touch screen |
| CN106293034A (en) * | 2015-06-11 | 2017-01-04 | 中兴通讯股份有限公司 | The method of a kind of information output and terminal |
| CN106855784A (en) * | 2016-12-16 | 2017-06-16 | 广东欧珀移动通信有限公司 | Prevent method, device and the terminal of touch key-press false triggering |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113778255A (en) * | 2021-07-29 | 2021-12-10 | 荣耀终端有限公司 | Touch recognition method and device |
| CN113778255B (en) * | 2021-07-29 | 2023-11-10 | 荣耀终端有限公司 | Touch recognition method and device |
| CN113885768A (en) * | 2021-10-19 | 2022-01-04 | 清华大学 | Auxiliary reading control method and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11810562B2 (en) | Reducing the need for manual start/end-pointing and trigger phrases | |
| US10777193B2 (en) | System and device for selecting speech recognition model | |
| US11217230B2 (en) | Information processing device and information processing method for determining presence or absence of a response to speech of a user on a basis of a learning result corresponding to a use situation of the user | |
| US10811005B2 (en) | Adapting voice input processing based on voice input characteristics | |
| EP3824462B1 (en) | Electronic apparatus for processing user utterance and controlling method thereof | |
| CN106251869B (en) | Voice processing method and device | |
| EP2385520A2 (en) | Method and device for generating text from spoken word | |
| EP3608906A1 (en) | System for processing user voice utterance and method for operating same | |
| KR20190074012A (en) | Method for processing speech signal of plurality of speakers and electric apparatus thereof | |
| CN109101517B (en) | Information processing method, information processing apparatus, and medium | |
| CN111831806B (en) | Semantic integrity determination method, device, electronic equipment and storage medium | |
| US10671343B1 (en) | Graphical interface to preview functionality available for speech-enabled processing | |
| EP3790001B1 (en) | Speech information processing method, device and storage medium | |
| CN112684936A (en) | Information identification method, storage medium and computer equipment | |
| KR20190096308A (en) | electronic device | |
| CN110827825A (en) | Punctuation prediction method, system, terminal and storage medium for speech recognition text | |
| CN111640434A (en) | Method and apparatus for controlling voice device | |
| CN104992715A (en) | Interface switching method and system of intelligent device | |
| CN111145604A (en) | Method and device for recognizing picture books and computer readable storage medium | |
| CN112328308A (en) | Method and device for recognizing text | |
| CN113096651A (en) | Voice signal processing method and device, readable storage medium and electronic equipment | |
| CN110827815A (en) | Voice recognition method, terminal, system and computer storage medium | |
| KR102685417B1 (en) | Electronic device and system for processing user input and method thereof | |
| CN116403577A (en) | Voice interaction method, voice interaction device, electronic equipment and computer readable storage medium | |
| CN110928519A (en) | Instruction generation method, intelligent keyboard and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20210420 |
|
| WW01 | Invention patent application withdrawn after publication |