CN111077995A - Control method of point-to-read mode and electronic equipment - Google Patents

Control method of point-to-read mode and electronic equipment Download PDF

Info

Publication number
CN111077995A
CN111077995A CN201910494076.7A CN201910494076A CN111077995A CN 111077995 A CN111077995 A CN 111077995A CN 201910494076 A CN201910494076 A CN 201910494076A CN 111077995 A CN111077995 A CN 111077995A
Authority
CN
China
Prior art keywords
area
electronic device
electronic equipment
read
learning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910494076.7A
Other languages
Chinese (zh)
Other versions
CN111077995B (en
Inventor
韦肖莹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Genius Technology Co Ltd
Original Assignee
Guangdong Genius Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Genius Technology Co Ltd filed Critical Guangdong Genius Technology Co Ltd
Priority to CN201910494076.7A priority Critical patent/CN111077995B/en
Publication of CN111077995A publication Critical patent/CN111077995A/en
Application granted granted Critical
Publication of CN111077995B publication Critical patent/CN111077995B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/04—Electrically-operated educational appliances with audible presentation of the material to be studied
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention relates to the technical field of electronic equipment, and discloses a control method of a point-to-read mode and the electronic equipment, wherein the control method is applied to the electronic equipment, a reflector is arranged on the electronic equipment and used for facing a certain specified area so as to capture a real-time mirror image corresponding to the specified area, and the method comprises the following steps: the electronic equipment utilizes a shooting module to identify whether a real-time mirror image corresponding to the specified area captured by the reflector contains a specified symbol for triggering the start of a point reading mode; and if the real-time mirror image contains the designated symbol, the electronic equipment controls the electronic equipment to automatically enter a point reading mode. By implementing the embodiment of the invention, the click-to-read mode of the electronic equipment can be conveniently started, and the user experience can be improved.

Description

Control method of point-to-read mode and electronic equipment
Technical Field
The present invention relates to the field of electronic devices, and in particular, to a method for controlling a touch and talk mode and an electronic device.
Background
In recent years, electronic devices (such as point-and-read machines) have been widely used for learning coaching. For example, electronic devices, such as point-and-read machines, can provide a point-and-read mode (also referred to as a point-and-read function) to assist a user in learning pronunciation. At present, if a user wants to use the click-to-read mode of the electronic device, the user needs to manually click a virtual button corresponding to the click-to-read mode of the electronic device to start the click-to-read mode of the electronic device, and the operation is complex, so that the user experience is reduced.
Disclosure of Invention
The embodiment of the invention discloses a control method of a click-to-read mode and electronic equipment, which can conveniently start the click-to-read mode of the electronic equipment and are beneficial to improving the experience of users.
The embodiment of the invention discloses a control method of a point reading mode, which is applied to electronic equipment, wherein a reflector is installed on the electronic equipment, and the reflector is used for facing a certain specified area so as to capture a real-time mirror image corresponding to the specified area, and the method comprises the following steps:
the electronic equipment identifies whether a real-time mirror image corresponding to the designated area captured by the reflector contains a designated symbol for triggering a start reading mode by using a shooting module;
and if the mirror image contains the designated symbol, the electronic equipment controls the electronic equipment to automatically enter the point reading mode.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the designated area is a learning page area, and the designated symbol is a character symbol that is drawn by a student user with a finger on the learning page area, or the designated symbol is a gesture symbol that is drawn by the student user with a finger on the learning page area.
As a further optional implementation manner, in the first aspect of the embodiment of the present invention, after the electronic device controls the electronic device to automatically enter the touch reading mode, the method further includes:
the electronic equipment identifies contents to be reported and read which are touched by the user for the student on the learning page area from the real-time mirror image corresponding to the learning page area captured by the reflector by using the shooting module;
the electronic equipment queries the palm type of the palm where the fingers touching the content to be read are located, wherein the palm type is a left palm or a right palm;
the electronic equipment queries a target preset voiceprint corresponding to the position information of the finger in the palm type from a preset voiceprint library;
and the electronic equipment adopts the target preset voiceprint to read the content to be read.
As a further optional implementation manner, in the first aspect of the embodiments of the present invention, the electronic device is any one electronic device provided in a certain learning environment and used by a student user, and the designated area is a teacher-specific control area in the learning environment; the teacher-specific control area is divided into a plurality of specific control sub-areas, and the designated symbol is a character symbol drawn by a teacher with fingers on any one target sub-area of the plurality of specific control sub-areas, or the designated symbol is a gesture symbol drawn by the teacher with fingers on the target sub-area.
As another optional implementation manner, in the first aspect of the embodiment of the present invention, after the electronic device recognizes that a real-time mirror image corresponding to the designated area captured by the mirror includes a designated symbol for triggering an open reading mode by using a shooting module, the method further includes:
and the electronic equipment checks whether the area identification of the target sub-area corresponds to the unique identification information of the electronic equipment, and if so, the electronic equipment is controlled to automatically enter the point reading mode.
As a further optional implementation manner, in the first aspect of the embodiment of the present invention, after the electronic device controls the electronic device to automatically enter the touch reading mode, the method further includes:
the electronic equipment detects the contents to be read and reported which are touched by the fingers of the student user on a learning page area;
the electronic equipment queries a target preset voiceprint corresponding to the area identification of the target subregion from a preset voiceprint library;
and the electronic equipment adopts the target preset voiceprint to read the content to be read.
A second aspect of the embodiments of the present invention discloses an electronic device, where a reflective mirror is installed on the electronic device, and the reflective mirror is used to face a certain specified area to capture a real-time mirror image corresponding to the specified area, and the electronic device includes:
the identification unit is used for identifying whether the real-time mirror image corresponding to the specified area captured by the reflector contains a specified symbol for triggering the start of the point reading mode by using the shooting module;
and the control unit is used for controlling the electronic equipment to automatically enter the point reading mode when the identification unit identifies that the mirror image contains the designated symbol.
As a further alternative implementation manner, in the first aspect of the embodiment of the present invention, the designated area is a learning page area, and the designated symbol is a character symbol that is drawn by a student user with a finger on the learning page area, or the designated symbol is a gesture symbol that is drawn by the student user with a finger on the learning page area.
As another alternative implementation, in the first aspect of the embodiment of the present invention:
the identification unit is further used for identifying contents to be read and reported which are touched by fingers of the student user on the learning page area from a real-time mirror image corresponding to the learning page area captured by the reflector by using the shooting module after the control unit controls the electronic equipment to automatically enter the point reading mode;
the electronic device further includes:
the first query unit is used for querying the palm type of the palm where the finger touching the content to be read is located, wherein the palm type is a left palm or a right palm; querying a target preset voiceprint corresponding to the position information of the finger in the palm type from a preset voiceprint library;
and the first reading unit is used for reading the content to be read by adopting the target preset voiceprint.
As a further optional implementation manner, in the first aspect of the embodiments of the present invention, the electronic device is any one electronic device provided in a certain learning environment and used by a student user, and the designated area is a teacher-specific control area in the learning environment; the teacher-specific control area is divided into a plurality of specific control sub-areas, and the designated symbol is a character symbol drawn by a teacher with fingers on any one target sub-area of the plurality of specific control sub-areas, or the designated symbol is a gesture symbol drawn by the teacher with fingers on the target sub-area.
As a further optional implementation manner, in the first aspect of the embodiment of the present invention, the electronic device further includes:
the verification unit is used for verifying whether the area identification of the target sub-area corresponds to the unique identification information of the electronic equipment or not after the identification unit identifies that the real-time mirror image corresponding to the specified area captured by the reflector by using the shooting module contains a specified symbol for triggering the start of the point reading mode;
the control unit is specifically configured to control the electronic device to automatically enter the point-reading mode when the identification unit identifies that the mirror image includes the designated symbol and when the verification unit verifies that the area identifier of the target sub-area corresponds to the unique identifier information of the electronic device.
As a further optional implementation manner, in the first aspect of the embodiment of the present invention, the electronic device further includes:
the detection unit is used for detecting the contents to be read and reported which are touched by the user for the student on a learning page area after the control unit controls the electronic equipment to automatically enter the point reading mode;
the second query unit is used for querying a target preset voiceprint corresponding to the area identifier of the target sub-area from a preset voiceprint library;
and the second reading unit is used for reading the content to be read by adopting the target preset voiceprint.
A third aspect of the embodiments of the present invention discloses another electronic device, including:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to execute all or part of the steps of any one of the control methods of the click-to-read mode disclosed in the first aspect of the embodiments of the present invention.
A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium, which is characterized by storing a computer program for electronic data exchange, wherein the computer program causes a computer to execute all or part of the steps in any one of the methods for controlling a read-and-click mode disclosed in the first aspect of the embodiments of the present invention.
A fifth aspect of the embodiments of the present invention discloses a computer program product, which, when running on a computer, causes the computer to execute part or all of the steps of any one of the methods for controlling a read-and-click mode in the first aspect of the embodiments of the present invention.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, for the electronic equipment, the electronic equipment can automatically enter the point reading mode as long as the shooting module is utilized to identify that the real-time mirror image corresponding to the specified area captured by the reflector installed on the electronic equipment contains the specified symbol for triggering the start of the point reading mode. Therefore, by implementing the embodiment of the invention, the user can be saved from manually clicking the virtual button corresponding to the click-to-read mode of the electronic equipment to start the click-to-read mode of the electronic equipment, so that the click-to-read mode of the electronic equipment can be conveniently started, and the user experience can be improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic flow chart of a control method of a point-to-read mode according to an embodiment of the present invention;
FIG. 2 is a flow chart illustrating another control method of a point-to-read mode according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a control method of another click-to-read mode according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure;
FIG. 5 is a schematic structural diagram of another electronic device disclosed in the embodiments of the present invention;
FIG. 6 is a schematic structural diagram of another electronic device disclosed in the embodiments of the present invention;
fig. 7 is a schematic structural diagram of another electronic device disclosed in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "comprises" and "comprising," and any variations thereof, of embodiments of the present invention are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a control method of a click-to-read mode and electronic equipment, which can conveniently start the click-to-read mode of the electronic equipment and are beneficial to improving the experience of users. The following detailed description is made with reference to the accompanying drawings.
Referring to fig. 1, fig. 1 is a flowchart illustrating a method for controlling a touch-and-read mode according to an embodiment of the present invention. The control method of the point-reading mode shown in fig. 1 is applied to an electronic device, and a reflective mirror is installed on the electronic device and used for facing a certain designated area to capture a real-time mirror image corresponding to the designated area. As shown in fig. 1, the method for controlling the click-to-read mode may include the following steps.
101. The electronic equipment identifies whether a real-time mirror image corresponding to the designated area captured by the reflector contains a designated symbol for triggering the start of the point reading mode by using the shooting module, and if the real-time mirror image does not contain the designated symbol, the process is ended; if so, go to step 102.
The electronic device may be a device or system with a reading function (e.g., a reading machine, a family education machine, etc.), and the embodiment of the present invention is not limited in particular.
In one embodiment, the electronic device may identify whether a real-time mirror image corresponding to a designated area captured by the reflector includes a designated symbol for triggering the start of the point-reading mode by using its own shooting module or an external shooting module, and if not, the process is ended; if so, go to step 102.
In one embodiment, the reflective mirror mounted on the electronic device may be a front reflective mirror, and a lens direction of a shooting module of the electronic device itself or an external shooting module may be adjusted to face a mirror surface of the front reflective mirror, so that the electronic device may use the shooting module of the electronic device itself or the external shooting module to shoot a real-time mirror image corresponding to a specified area captured by the reflective mirror, and identify whether the shot real-time mirror image includes a specified symbol for triggering a start-up touch-and-talk mode, and if not, end the process; if so, go to step 102.
In one embodiment, the designated symbol for triggering the on-click mode may be a character symbol (e.g., character "D") scribed with a finger for triggering the on-click mode; alternatively, the gesture symbol may be a finger-out gesture symbol (e.g., a gesture symbol of extending out of biye) for triggering the open reading mode, and the embodiment of the present invention is not limited thereto.
102. The electronic equipment controls the electronic equipment to automatically enter a point reading mode.
In one embodiment, after the electronic device controls the electronic device to automatically enter the reading mode, the electronic device may prompt the electronic device that the reading mode is entered by means of a voice prompt and/or an interface prompt, so that the user can start reading learning.
As an optional implementation manner, after the electronic device controls the electronic device to automatically enter the touch and talk mode, the electronic device may detect whether the electronic device is connected to a wireless touch and talk pen, wherein a cursor projection ring is disposed at an end where a pen point of the wireless touch and talk pen is located; if the electronic equipment is detected to be connected with the wireless point-reading pen, the electronic equipment can further detect the average clamping pressure when the wireless point-reading pen is clamped by fingers (such as a thumb and an index finger), and the electronic equipment can control a cursor projection ring arranged at one end where a pen point of the wireless point-reading pen is located to project a cursor ring taking the pen point of the wireless point-reading pen as a circle center, wherein the radius value of the cursor ring is in direct proportion to the average clamping pressure; the electronic device can recognize the content of the cursor ring through the shooting module, or the electronic device can acquire the content of the cursor ring recognized by the wireless touch and talk pen through the shooting module, and the electronic device can use the content of the cursor ring as the content to be read.
By implementing the implementation mode, the pen point of the wireless point-reading pen can be prevented from directly contacting the contents on the learning page to perform point-reading learning, so that remote and non-contact point-reading learning can be realized.
Therefore, by implementing the control method described in fig. 1, the user can be saved from manually clicking a virtual button corresponding to the click-to-read mode of the electronic device to start the click-to-read mode of the electronic device, so that the click-to-read mode of the electronic device can be conveniently started, and the user experience can be improved.
Referring to fig. 2, fig. 2 is a schematic flow chart illustrating another control method of a touch-and-talk mode according to an embodiment of the present invention. The control method of the point-reading mode shown in fig. 2 is applied to an electronic device, where a reflective mirror is installed on the electronic device, and the reflective mirror is used to face a certain learning page area (belonging to a designated area) to capture a real-time mirror image corresponding to the learning page area. As shown in fig. 2, the method for controlling the click-to-read mode may include the following steps.
201. The electronic equipment identifies whether a real-time mirror image corresponding to a learning page area captured by a reflector contains character symbols which are used for triggering an opening point-reading mode and are drawn by fingers of a student user on the learning page area or gesture symbol designated symbols which are drawn by the student user on the learning page area by fingers; if not, ending the process; if so, go to step 202.
For example, the learning page area may be a paper learning page area, or an electronic learning page area displayed in a certain display screen, which is not limited in the embodiment of the present invention.
202. The electronic equipment controls the electronic equipment to automatically enter a point reading mode.
In one embodiment, after the electronic device controls the electronic device to automatically enter the reading mode, the electronic device may prompt the electronic device that the reading mode is entered by means of a voice prompt and/or an interface prompt, so that the user can start reading learning.
As an alternative implementation manner, after the electronic device performs step 202 and before performing step 203 to step 206, the electronic device may further perform the following steps:
the electronic equipment can detect whether the electronic equipment is connected with the wireless touch and talk pen or not, wherein a cursor projection ring is arranged at one end of the wireless touch and talk pen where a pen point is located; if the electronic equipment is not connected with the wireless touch and talk pen, the electronic equipment executes the step 203 to the step 206; if it is detected that the electronic device is connected to the wireless touch and talk pen, the electronic device may further perform the following steps:
the electronic equipment detects the average clamping pressure when the wireless point-reading pen is clamped and pressed by fingers (such as a thumb and an index finger), and can control a cursor projection ring arranged at one end where a pen point of the wireless point-reading pen is located to project a cursor ring with the pen point of the wireless point-reading pen as a circle center, wherein the radius value of the cursor ring is in direct proportion to the average clamping pressure;
the electronic device can recognize the content of the cursor ring (such as the content of the cursor ring on the learning page area) through the shooting module, or the electronic device can acquire the content of the cursor ring recognized by the wireless point reading pen through the shooting module (such as the content of the cursor ring on the learning page area);
and the electronic equipment can use the content of the cursor ring as the content to be read for reading.
Optionally, when the distance between the pen point of the wireless touch and talk pen and the learning page area is reduced, the cursor ring is reduced, and accordingly, the content enclosed by the cursor ring is reduced; on the contrary, when the distance between the pen point of the wireless point-and-read pen and the learning page area is increased, the cursor ring is increased, and correspondingly, the content enclosed by the cursor ring is increased.
Optionally, the size of the cursor ring may be kept unchanged no matter whether the distance between the pen tip of the wireless point-and-read pen and the learning page area is smaller or larger, and accordingly, the number of contents enclosed by the cursor ring may also be kept unchanged.
By implementing the implementation mode, the pen point of the wireless point-reading pen can be prevented from directly contacting the contents on the learning page to perform point-reading learning, so that remote and non-contact point-reading learning can be realized.
203. The electronic equipment utilizes the shooting module to identify the contents to be reported and read which are touched by the student user on the learning page area by fingers from the real-time mirror image corresponding to the learning page area captured by the reflector.
204. The electronic equipment inquires out the palm type of the palm where the finger touching the content to be read is located, wherein the palm type is a left palm or a right palm.
205. And the electronic equipment inquires out a target preset voiceprint corresponding to the position information of the finger in the palm type from a preset voiceprint library.
For example, when the finger is the index finger, the position information of the finger in the palm type (e.g., left palm) may be the position of the index finger in the palm type (e.g., left palm); for another example, when the finger is the middle finger, the position information of the finger in the palm type (e.g., left palm) may be the position of the middle finger in the palm type (e.g., left palm); for another example, when the finger is a little finger, the position information of the finger in the palm type (e.g., left palm) may be the position of the little finger in the palm type (e.g., left palm).
When the position information of the finger in the palm type changes, the target corresponding to the position information of the finger in the palm type is preset, and the voiceprint correspondingly changes, so that the combination of point reading learning and tone simulation can be realized, and the experience of the point reading learning is favorably improved.
206. The electronic equipment adopts the target preset voiceprint to read the content to be read.
In one embodiment, after the electronic device performs step 206, the following steps may also be performed:
the electronic equipment acquires the face image information of the user, binds the face image information of the user and the content of the learning page area and sends the binding result to the teacher terminal bound with the face image information of the user.
In one embodiment, the electronic device may obtain the facial image information of the user through a self-contained shooting module or an external shooting module.
For example, the learning page area may be a learning page area assigned by the teacher of the teacher terminal to the user (e.g., a student) and requiring the user to perform reading learning, and accordingly, the implementation of the above manner may facilitate the teacher to know whether the user performs reading learning on the assigned learning page area requiring the user to perform reading learning, so as to achieve an effect of knowing the learning dynamics of the user.
Therefore, by implementing the control method described in fig. 2, the user can be saved from manually clicking the virtual button corresponding to the click-to-read mode of the electronic device to start the click-to-read mode of the electronic device, so that the click-to-read mode of the electronic device can be conveniently started, and the user experience can be improved.
In addition, by implementing the control method described in fig. 2, the pen point of the wireless point-and-read pen can be prevented from directly contacting the content on the learning page for point-and-read learning, so that remote and non-contact point-and-read learning can be realized.
In addition, by implementing the control method described in fig. 2, the combination of the point reading learning and the tone simulation can be realized, which is beneficial to improving the experience of the point reading learning.
Referring to fig. 3, fig. 3 is a flowchart illustrating another control method of a touch-and-read mode according to an embodiment of the present invention. The control method of the click-to-read mode shown in fig. 3 is applied to an electronic device, the electronic device is any one of electronic devices arranged in a certain learning environment and used by a student user, a reflective mirror is installed on the electronic device, and the reflective mirror is used for facing a teacher-specific control area (belonging to a designated area) in the learning environment so as to capture a real-time mirror image corresponding to the teacher-specific control area. The teacher exclusive control area is divided into a plurality of exclusive control sub-areas, and the area identifier of each exclusive control sub-area corresponds to the unique identifier information of one electronic device in the learning environment. For example, the teacher may pre-configure, on the electronic device a1 in the learning environment, a correspondence between the unique identification information of the electronic device a1 and the area identification of one dedicated control sub-area B1, where the correspondence indicates that the dedicated control sub-area B1 is the only legal area for the teacher to control the electronic device a 1. For another example, the teacher may pre-configure, on the electronic device a2 in the learning environment, a correspondence between the unique identification information of the electronic device a2 and the area identification of one dedicated control sub-area B2, where the correspondence is used to indicate that the dedicated control sub-area B2 is the only legal area for the teacher to control the electronic device a 2. As shown in fig. 3, the method for controlling the click-to-read mode may include the following steps.
301. The electronic equipment utilizes the shooting module to identify whether a real-time mirror image corresponding to the teacher exclusive control area captured by the reflector contains character symbols drawn by the teacher with fingers on any one target subarea of the plurality of exclusive control subareas or gesture symbols drawn by the teacher with fingers on the target subarea for triggering the start point reading mode; if not, ending the process; if so, go to step 302.
The reflectors installed on each electronic device in the learning environment face a teacher-specific control area (belonging to a designated area) in the learning environment, and are used for capturing real-time images corresponding to the teacher-specific control area. For example, the teacher-specific control area may be a planar control area in the learning environment, such as a screen area of a teaching device in the learning environment or a partial area of a wall in the learning environment, and the embodiments of the present invention are not limited thereto.
302. The electronic equipment checks whether the area identification of the target sub-area corresponds to the unique identification information of the electronic equipment, if not, the process is ended; if yes, go to step 303-step 307.
303. The electronic equipment controls the electronic equipment to automatically enter a point reading mode.
In the embodiment of the present invention, by implementing the steps 301 to 303, the teacher may flexibly and accurately start the reading mode of some electronic devices in a learning environment in a non-contact manner, so as to improve the flexibility and accuracy of starting the reading mode of some electronic devices in a learning environment.
As an alternative implementation, after the electronic device performs step 303 and before performing steps 304 to 306, the electronic device may further perform the following steps:
the electronic equipment can detect whether the electronic equipment is connected with the wireless touch and talk pen or not, wherein a cursor projection ring is arranged at one end of the wireless touch and talk pen where a pen point is located; if the electronic equipment is not connected with the wireless touch and talk pen, the electronic equipment executes the step 304 to the step 306; if it is detected that the electronic device is connected to the wireless touch and talk pen, the electronic device may further perform the following steps:
the electronic equipment detects the average clamping pressure when the wireless point-reading pen is clamped and pressed by fingers (such as a thumb and an index finger), and can control a cursor projection ring arranged at one end where a pen point of the wireless point-reading pen is located to project a cursor ring with the pen point of the wireless point-reading pen as a circle center, wherein the radius value of the cursor ring is in direct proportion to the average clamping pressure;
the electronic device can recognize the content of the cursor ring (such as the content of the cursor ring on the learning page area) through the shooting module, or the electronic device can acquire the content of the cursor ring recognized by the wireless point reading pen through the shooting module (such as the content of the cursor ring on the learning page area);
and the electronic equipment can use the content of the cursor ring as the content to be read for reading.
By implementing the implementation mode, the pen point of the wireless point-reading pen can be prevented from directly contacting the contents on the learning page to perform point-reading learning, so that remote and non-contact point-reading learning can be realized.
304. The electronic equipment detects the contents to be read which are touched by the user with fingers on the learning page area.
305. And the electronic equipment inquires out a target preset voiceprint corresponding to the area identification of the target subregion from a preset voiceprint library.
The target preset voiceprints corresponding to the area identifications of different target sub-areas can be different, so that the combination of point reading learning and tone simulation can be realized, and the experience of the point reading learning is promoted.
306. The electronic equipment adopts the target preset voiceprint to read the content to be read.
In one embodiment, after the electronic device performs step 206, the following steps may also be performed:
the electronic equipment acquires the face image information of the user, binds the face image information of the user and the content of the learning page area and sends the binding result to the teacher terminal bound with the area identifier of the target sub-area.
In one embodiment, the electronic device may obtain the facial image information of the user through a self-contained shooting module or an external shooting module.
For example, the learning page area may be a learning page area assigned by the teacher of the teacher terminal to the user (e.g., a student) and requiring the user to perform reading learning, and accordingly, the implementation of the above manner may facilitate the teacher to know whether the user performs reading learning on the assigned learning page area requiring the user to perform reading learning, so as to achieve an effect of knowing the learning dynamics of the user.
Therefore, by implementing the control method described in fig. 3, the user can be saved from manually clicking the virtual button corresponding to the click-to-read mode of the electronic device to start the click-to-read mode of the electronic device, so that the click-to-read mode of the electronic device can be conveniently started, and the user experience can be improved.
In addition, by implementing the control method described in fig. 3, the pen point of the wireless point-and-read pen can be prevented from directly contacting the content on the learning page for point-and-read learning, so that remote and non-contact point-and-read learning can be realized.
In addition, by implementing the control method described in fig. 3, the combination of the point reading learning and the tone simulation can be realized, which is beneficial to improving the experience of the point reading learning.
In addition, the control method described in fig. 3 can improve the flexibility and accuracy of turning on the click-to-read mode of some electronic devices in a learning environment.
Referring to fig. 4, fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure. The electronic device shown in fig. 4 may be mounted with a mirror (e.g., a front mirror) that faces a specific area to capture a real-time image corresponding to the specific area. As shown in fig. 4, the electronic device may include:
the identification unit 401 is configured to identify, by using a shooting module, whether a real-time mirror image corresponding to the specified area captured by the mirror includes a specified symbol for triggering a start-up touch-and-talk mode;
a control unit 402, configured to control the electronic device to automatically enter the touch and talk mode when the identification unit 401 identifies that the real-time image includes the designated symbol.
As an alternative implementation manner, after the control unit 402 controls the electronic device to automatically enter the touch and talk mode, the electronic device may detect whether the electronic device is connected to a wireless touch and talk pen, where an end of the wireless touch and talk pen where a pen point is located is provided with a cursor projection ring; if the electronic equipment is detected to be connected with the wireless point-reading pen, the electronic equipment can further detect the average clamping pressure when the wireless point-reading pen is clamped by fingers (such as a thumb and an index finger), and the electronic equipment can control a cursor projection ring arranged at one end where a pen point of the wireless point-reading pen is located to project a cursor ring taking the pen point of the wireless point-reading pen as a circle center, wherein the radius value of the cursor ring is in direct proportion to the average clamping pressure; the electronic device can recognize the content of the cursor ring through the shooting module, or the electronic device can acquire the content of the cursor ring recognized by the wireless touch and talk pen through the shooting module, and the electronic device can use the content of the cursor ring as the content to be read.
By implementing the implementation mode, the pen point of the wireless point-reading pen can be prevented from directly contacting the contents on the learning page to perform point-reading learning, so that remote and non-contact point-reading learning can be realized.
Therefore, by implementing the electronic device described in fig. 4, the user can be saved from manually clicking the virtual button corresponding to the click-to-read mode of the electronic device to start the click-to-read mode of the electronic device, so that the click-to-read mode of the electronic device can be conveniently started, and the user experience can be improved.
Referring to fig. 5, fig. 5 is a schematic structural diagram of another electronic device according to an embodiment of the disclosure. The electronic device shown in fig. 5 is optimized from the electronic device shown in fig. 4. In the electronic apparatus shown in fig. 5, the designated area is a learning page area, and the designated symbol is a character symbol that the student user has marked out with a finger on the learning page area, or the designated symbol is a gesture symbol that the student user has marked out with a finger on the learning page area.
Correspondingly, the identifying unit 401 is further configured to identify, by using the shooting module, the content to be read and reported that the student user touches the learning page area with the finger from the real-time image corresponding to the learning page area captured by the mirror after the control unit 402 controls the electronic device to automatically enter the point-to-read mode;
further, compared to the electronic device shown in fig. 4, the electronic device shown in fig. 5 further includes:
a first query unit 403, configured to query a palm type of a palm where the finger touching the content to be read is located, where the palm type is a left palm or a right palm; querying a target preset voiceprint corresponding to the position information of the finger in the palm type from a preset voiceprint library;
the first reading unit 404 is configured to read the content to be read by using the target preset voiceprint.
When the position information of the finger in the palm type changes, the target corresponding to the position information of the finger in the palm type is preset, and the voiceprint correspondingly changes, so that the combination of point reading learning and tone simulation can be realized, and the experience of the point reading learning is favorably improved.
In an embodiment, after the first reading unit 404 reads the content to be read by using the target preset voiceprint, the electronic device may further perform the following operations:
the electronic equipment acquires the face image information of the user, binds the face image information of the user and the content of the learning page area and sends the binding result to the teacher terminal bound with the face image information of the user.
Therefore, by implementing the electronic device described in fig. 5, the user can be saved from manually clicking the virtual button corresponding to the click-to-read mode of the electronic device to start the click-to-read mode of the electronic device, so that the click-to-read mode of the electronic device can be conveniently started, and the user experience can be improved.
In addition, the electronic device described in fig. 5 can prevent the pen point of the wireless touch-and-talk pen from directly contacting the contents on the learning page to perform touch-and-talk learning, so that remote and non-contact touch-and-talk learning can be realized.
In addition, the electronic device described in fig. 5 can be implemented to combine click-to-read learning and tone simulation, which is beneficial to improving the experience of click-to-read learning.
Referring to fig. 6, fig. 6 is a schematic structural diagram of another electronic device according to an embodiment of the disclosure. The electronic device shown in fig. 6 is optimized from the electronic device shown in fig. 4. The electronic device shown in fig. 6 is any one of electronic devices provided in a learning environment and used by student users, and the designated area is a teacher-specific control area in the learning environment; the teacher-dedicated control area is divided into a plurality of dedicated control sub-areas, and the designated symbol is a character symbol drawn by a teacher with fingers on any target sub-area of the plurality of dedicated control sub-areas, or is a gesture symbol drawn by the teacher with fingers on the target sub-area.
Further, compared to the electronic device shown in fig. 4, the electronic device shown in fig. 5 further includes:
the checking unit 405 is configured to check whether the area identifier of the target sub-area corresponds to the unique identifier information of the electronic device after the identifying unit 401 identifies, by using the shooting module, that the real-time mirror image corresponding to the specified area captured by the mirror includes the specified symbol for triggering the start reading mode;
correspondingly, the control unit 402 is specifically configured to control the electronic device to automatically enter the point-reading mode when the identification unit 401 identifies that the real-time image includes the designated symbol, and when the verification unit 405 verifies that the area identifier of the target sub-area corresponds to the unique identifier information of the electronic device.
Further, the electronic device shown in fig. 5 further includes:
a detection unit 406, configured to detect, after the control unit 402 controls the electronic device to automatically enter the touch-and-read mode, content to be read and posted that a student user touches with a finger on a learning page area;
a second query unit 407, configured to query a preset target voiceprint corresponding to the area identifier of the target sub-area from the preset voiceprint library;
the second reading unit 408 is configured to read the content to be read by using a target preset voiceprint.
In an embodiment, after the second reading unit 408 reads the content to be read by using the target preset voiceprint, the electronic device may further perform the following operations:
the electronic equipment acquires the face image information of the user, binds the face image information of the user and the content of the learning page area and sends the binding result to the teacher terminal bound with the area identifier of the target sub-area.
In one embodiment, the electronic device may obtain the facial image information of the user through a self-contained shooting module or an external shooting module.
For example, the learning page area may be a learning page area assigned by the teacher of the teacher terminal to the user (e.g., a student) and requiring the user to perform reading learning, and accordingly, the implementation of the above manner may facilitate the teacher to know whether the user performs reading learning on the assigned learning page area requiring the user to perform reading learning, so as to achieve an effect of knowing the learning dynamics of the user.
Therefore, by implementing the electronic device described in fig. 6, the user can be saved from manually clicking the virtual button corresponding to the click-to-read mode of the electronic device to start the click-to-read mode of the electronic device, so that the click-to-read mode of the electronic device can be conveniently started, and the user experience can be improved.
In addition, the electronic device described in fig. 6 can prevent the pen point of the wireless touch-and-talk pen from directly contacting the contents on the learning page to perform touch-and-talk learning, so that remote and non-contact touch-and-talk learning can be realized.
In addition, the electronic device described in fig. 6 can realize the combination of the point reading learning and the tone simulation, and is favorable for improving the experience of the point reading learning.
In addition, the electronic device described in fig. 6 can be implemented to improve the flexibility and accuracy of turning on the click-to-read mode of some electronic devices in a learning environment.
Referring to fig. 7, fig. 7 is a schematic structural diagram of another electronic device according to an embodiment of the disclosure. As shown in fig. 7, the electronic device may include:
a memory 701 in which executable program code is stored;
a processor 702 coupled to the memory 701;
the processor 702 calls the executable program code stored in the memory 701 to execute all or part of the steps of any one of the methods in fig. 1 to 3.
In addition, the embodiment of the invention further discloses a computer readable storage medium which stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute all or part of the steps in any one of the human-computer interaction methods in fig. 1-3.
In addition, the embodiment of the invention further discloses a computer program product, which enables all or part of steps in any one method of the computer 1-3 to be executed when the computer program product runs on a computer.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by instructions associated with a program, which may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), compact disc-Read-Only Memory (CD-ROM), or other Memory, magnetic disk, magnetic tape, or magnetic tape, Or any other medium which can be used to carry or store data and which can be read by a computer.
The above detailed description is provided for the control method of the click-to-read mode and the electronic device disclosed in the embodiments of the present invention, and a specific example is applied in the detailed description to explain the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (12)

1. A control method of a point-reading mode is applied to an electronic device, and is characterized in that a reflector is mounted on the electronic device, and the reflector is used for facing a certain specified area so as to capture a real-time mirror image corresponding to the specified area, and the method comprises the following steps:
the electronic equipment identifies whether a real-time mirror image corresponding to the designated area captured by the reflector contains a designated symbol for triggering a start reading mode by using a shooting module;
and if the real-time mirror image contains the designated symbol, the electronic equipment controls the electronic equipment to automatically enter the point reading mode.
2. The control method according to claim 1, wherein the designated area is a learning page area, and the designated symbol is a character symbol that a student user makes with a finger on the learning page area, or a gesture symbol that a student user makes with a finger on the learning page area.
3. The method of claim 2, wherein after the electronic device controls the electronic device to automatically enter the touch-and-talk mode, the method further comprises:
the electronic equipment identifies contents to be reported and read which are touched by the user for the student on the learning page area from the real-time mirror image corresponding to the learning page area captured by the reflector by using the shooting module;
the electronic equipment queries the palm type of the palm where the fingers touching the content to be read are located, wherein the palm type is a left palm or a right palm;
the electronic equipment queries a target preset voiceprint corresponding to the position information of the finger in the palm type from a preset voiceprint library;
and the electronic equipment adopts the target preset voiceprint to read the content to be read.
4. The control method according to claim 1, wherein the electronic device is any one of electronic devices provided in a learning environment and used by student users, and the designated area is a teacher-specific control area in the learning environment; the teacher-specific control area is divided into a plurality of specific control sub-areas, and the designated symbol is a character symbol drawn by a teacher with fingers on any one target sub-area of the plurality of specific control sub-areas, or the designated symbol is a gesture symbol drawn by the teacher with fingers on the target sub-area.
5. The control method of claim 4, wherein after the electronic device recognizes, by using a shooting module, that a real-time mirror image corresponding to the designated area captured by the mirror includes a designated symbol for triggering an on-click-to-read mode, the method further comprises:
and the electronic equipment checks whether the area identification of the target sub-area corresponds to the unique identification information of the electronic equipment, and if so, the electronic equipment is controlled to automatically enter the point reading mode.
6. The method of claim 5, wherein after the electronic device controls the electronic device to automatically enter the touch-and-talk mode, the method further comprises:
the electronic equipment detects the contents to be read and reported which are touched by the fingers of the student user on a learning page area;
the electronic equipment queries a target preset voiceprint corresponding to the area identification of the target subregion from a preset voiceprint library;
and the electronic equipment adopts the target preset voiceprint to read the content to be read.
7. An electronic device, wherein a mirror is installed on the electronic device, and the mirror is configured to face a specific area to capture a real-time image corresponding to the specific area, and the electronic device includes:
the identification unit is used for identifying whether the real-time mirror image corresponding to the specified area captured by the reflector contains a specified symbol for triggering the start of the point reading mode by using the shooting module;
and the control unit is used for controlling the electronic equipment to automatically enter the point reading mode when the identification unit identifies that the real-time mirror image contains the designated symbol.
8. The electronic device of claim 7, wherein the designated area is a learning page area, and the designated symbol is a character symbol that a student user makes with a finger on the learning page area, or a gesture symbol that a student user makes with a finger on the learning page area.
9. The electronic device of claim 8, wherein:
the identification unit is further used for identifying contents to be read and reported which are touched by fingers of the student user on the learning page area from a real-time mirror image corresponding to the learning page area captured by the reflector by using the shooting module after the control unit controls the electronic equipment to automatically enter the point reading mode;
the electronic device further includes:
the first query unit is used for querying the palm type of the palm where the finger touching the content to be read is located, wherein the palm type is a left palm or a right palm; querying a target preset voiceprint corresponding to the position information of the finger in the palm type from a preset voiceprint library;
and the first reading unit is used for reading the content to be read by adopting the target preset voiceprint.
10. The electronic device according to claim 7, wherein the electronic device is any one of electronic devices provided in a learning environment and used by student users, and the designated area is a teacher-specific control area in the learning environment; the teacher-specific control area is divided into a plurality of specific control sub-areas, and the designated symbol is a character symbol drawn by a teacher with fingers on any one target sub-area of the plurality of specific control sub-areas, or the designated symbol is a gesture symbol drawn by the teacher with fingers on the target sub-area.
11. The electronic device of claim 10, further comprising:
the verification unit is used for verifying whether the area identification of the target sub-area corresponds to the unique identification information of the electronic equipment or not after the identification unit identifies that the real-time mirror image corresponding to the specified area captured by the reflector by using the shooting module contains a specified symbol for triggering the start of the point reading mode;
the control unit is specifically configured to control the electronic device to automatically enter the point-reading mode when the identification unit identifies that the mirror image includes the designated symbol and when the verification unit verifies that the area identifier of the target sub-area corresponds to the unique identifier information of the electronic device.
12. The electronic device of claim 11, further comprising:
the detection unit is used for detecting the contents to be read and reported which are touched by the user for the student on a learning page area after the control unit controls the electronic equipment to automatically enter the point reading mode;
the second query unit is used for querying a target preset voiceprint corresponding to the area identifier of the target sub-area from a preset voiceprint library;
and the second reading unit is used for reading the content to be read by adopting the target preset voiceprint.
CN201910494076.7A 2019-06-09 2019-06-09 Control method of click-to-read mode and electronic equipment Active CN111077995B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910494076.7A CN111077995B (en) 2019-06-09 2019-06-09 Control method of click-to-read mode and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910494076.7A CN111077995B (en) 2019-06-09 2019-06-09 Control method of click-to-read mode and electronic equipment

Publications (2)

Publication Number Publication Date
CN111077995A true CN111077995A (en) 2020-04-28
CN111077995B CN111077995B (en) 2023-07-25

Family

ID=70310054

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910494076.7A Active CN111077995B (en) 2019-06-09 2019-06-09 Control method of click-to-read mode and electronic equipment

Country Status (1)

Country Link
CN (1) CN111077995B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102289957A (en) * 2011-09-01 2011-12-21 中国科学院深圳先进技术研究院 Reading machine and sounding method thereof
CN104217197A (en) * 2014-08-27 2014-12-17 华南理工大学 Touch reading method and device based on visual gestures
CN109255989A (en) * 2018-08-30 2019-01-22 广东小天才科技有限公司 Intelligent touch reading method and touch reading equipment
CN109274898A (en) * 2018-08-08 2019-01-25 深圳市智像科技有限公司 File and picture intelligent acquisition methods, devices and systems

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102289957A (en) * 2011-09-01 2011-12-21 中国科学院深圳先进技术研究院 Reading machine and sounding method thereof
CN104217197A (en) * 2014-08-27 2014-12-17 华南理工大学 Touch reading method and device based on visual gestures
CN109274898A (en) * 2018-08-08 2019-01-25 深圳市智像科技有限公司 File and picture intelligent acquisition methods, devices and systems
CN109255989A (en) * 2018-08-30 2019-01-22 广东小天才科技有限公司 Intelligent touch reading method and touch reading equipment

Also Published As

Publication number Publication date
CN111077995B (en) 2023-07-25

Similar Documents

Publication Publication Date Title
EP2680110B1 (en) Method and apparatus for processing multiple inputs
CN105824559B (en) False touch recognition and processing method and electronic equipment
US8452057B2 (en) Projector and projection control method
CN109255989B (en) Intelligent touch reading method and touch reading equipment
CN102609166A (en) Display method and terminal
CN111077996B (en) Information recommendation method and learning device based on click-to-read
CN108874284B (en) Gesture triggering method
CN109976656B (en) Page turning control method for browsing webpage and user terminal
US20150370473A1 (en) Using a symbol recognition engine
CN115048027A (en) Handwriting input method, device, system, electronic equipment and storage medium
CN107132927B (en) Input character recognition method and device for recognizing input characters
CN106845190B (en) Display control system and method
CN111077993B (en) Learning scene switching method, electronic equipment and storage medium
CN111160097B (en) Content identification method and device
CN111077995B (en) Control method of click-to-read mode and electronic equipment
CN111077997A (en) Point reading control method in point reading mode and electronic equipment
CN111090383B (en) Instruction identification method and electronic equipment
CN115097928A (en) Gesture control method and device, electronic equipment and storage medium
CN114860143A (en) Navigation control method and device, terminal equipment and storage medium
CN111077990B (en) Method for determining content to be read on spot and learning equipment
CN111079498B (en) Learning function switching method based on mouth shape recognition and electronic equipment
CN111090382B (en) Character content input method and terminal equipment
CN111078099A (en) Learning function switching method based on gesture recognition and learning equipment
CN111079493A (en) Electronic equipment-based man-machine interaction method and electronic equipment
CN111077989A (en) Screen control method based on electronic equipment and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant