CN112446349A - Handwriting detection method and device - Google Patents
Handwriting detection method and device Download PDFInfo
- Publication number
- CN112446349A CN112446349A CN202011446028.XA CN202011446028A CN112446349A CN 112446349 A CN112446349 A CN 112446349A CN 202011446028 A CN202011446028 A CN 202011446028A CN 112446349 A CN112446349 A CN 112446349A
- Authority
- CN
- China
- Prior art keywords
- information
- error
- handwriting
- error information
- writing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/30—Writer recognition; Reading and verifying signatures
- G06V40/37—Writer recognition; Reading and verifying signatures based only on signature signals such as velocity or pressure, e.g. dynamic signature recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present disclosure provides a handwriting detection method and apparatus, including: acquiring writing information of a user; identifying first error information in the handwriting information of the user; generating comment information for the user based on the first error information; and displaying the comment information and a labeling result of the handwriting information, wherein the labeling result is labeled based on the first error information.
Description
Technical Field
The disclosure relates to the technical field of computers, in particular to a handwriting detection method and device.
Background
Students need to learn to practice calligraphy to master each font. In the related art, a teacher or a parent generally supervises the calligraphy practicing process of students, however, as the teacher needs to supervise many students, the real-time supervision of each student may not be realized; parents may have poor supervision over students due to insufficient knowledge of fonts, such as stroke order issues, etc.
Disclosure of Invention
The embodiment of the disclosure at least provides a handwriting detection method and device.
In a first aspect, an embodiment of the present disclosure provides a handwriting detection method, including:
acquiring writing information of a user;
identifying first error information in the handwriting information of the user;
generating comment information for the user based on the first error information;
and displaying the comment information and a labeling result of the handwriting information, wherein the labeling result is labeled based on the first error information.
In a possible embodiment, the first error information includes error information under at least one error type;
the error type includes at least one of the following errors:
a font error, a writing process error, and a writing aesthetic error.
In a possible embodiment, the method further comprises:
acquiring writing state information of the user;
determining second error information of the writing state of the user based on the writing state information of the user;
the generating of the comment information for the user based on the first error information includes:
generating comment information for the user based on the first error information and the second error information.
In one possible embodiment, the writing state information includes a pen-holding posture and/or a writing speed.
In one possible embodiment, the generating of the comment information for the user based on the first error information and the second error information includes:
and splicing the first error information and the second error information according to a preset sequence to generate the comment information.
In one possible embodiment, the generating of the comment information for the user based on the first error information and the second error information includes:
acquiring a comment template aiming at the user;
and adding the first error information and the second error information to corresponding positions of the commenting template to generate the commenting information.
In one possible embodiment, the first error information includes error information for at least one stroke;
the displaying the comment information and the labeling result of the handwriting information comprise:
generating audio information corresponding to the comment information based on the comment information;
and playing the audio information and displaying a labeling result of error information of at least one stroke in a writing result corresponding to the handwriting information.
In a possible implementation manner, the playing the audio information and displaying a labeling result of error information of at least one stroke in a writing result corresponding to the writing trace information includes:
and when target audio information corresponding to the error information of the target stroke in the audio information is played, displaying a labeling result of the error information of the target stroke.
In one possible embodiment, the first error information includes error information for at least one stroke;
displaying the comment information and a labeling result of the handwriting information, wherein the displaying comprises the following steps:
generating video information corresponding to the comment information based on the comment information;
and playing the video information in a preset position area of a current display interface, and displaying a marking result of error information of at least one stroke in a writing result corresponding to the writing handwriting information.
In a possible implementation manner, the playing the video information in a preset position area of a current display interface and displaying a labeling result of error information of at least one stroke in a writing result corresponding to the writing trace information includes:
and when target video information corresponding to the error information of the target stroke in the video information is played, displaying the labeling result of the error information of the target stroke.
In one possible embodiment, when the handwriting information corresponds to a plurality of words, the method further includes:
responding to a trigger operation for any word;
and displaying the comment information corresponding to any character and the marking result of the handwriting information of any character.
In a second aspect, an embodiment of the present disclosure further provides a handwriting detection apparatus, including:
the acquisition module is used for acquiring handwriting information of a user;
the recognition module is used for recognizing first error information in the handwriting information of the user;
a generation module configured to generate comment information for the user based on the first error information;
and the display module is used for displaying the comment information and a labeling result of the handwriting information, wherein the labeling result is labeled based on the first error information.
In a possible embodiment, the first error information includes error information under at least one error type;
the error type includes at least one of the following errors:
a font error, a writing process error, and a writing aesthetic error.
In a possible implementation manner, the obtaining module is further configured to obtain writing state information of the user;
the recognition module is further used for determining second error information of the writing state of the user based on the writing state information of the user;
the generating module, when generating the comment information for the user based on the first error information, is configured to:
generating comment information for the user based on the first error information and the second error information.
In one possible embodiment, the writing state information includes a pen-holding posture and/or a writing speed.
In a possible embodiment, the generating module, when generating the comment information for the user based on the first error information and the second error information, is configured to:
and splicing the first error information and the second error information according to a preset sequence to generate the comment information.
In a possible embodiment, the generating module, when generating the comment information for the user based on the first error information and the second error information, is configured to:
acquiring a comment template aiming at the user;
and adding the first error information and the second error information to corresponding positions of the commenting template to generate the commenting information.
In one possible embodiment, the first error information includes error information for at least one stroke;
the display module is used for displaying the comment information and the marking result of the handwriting information:
generating audio information corresponding to the comment information based on the comment information;
and playing the audio information and displaying a labeling result of error information of at least one stroke in a writing result corresponding to the handwriting information.
In a possible implementation manner, the presentation module, when playing the audio information and presenting a labeling result of error information of at least one stroke in a writing result corresponding to the writing trace information, is configured to:
and when target audio information corresponding to the error information of the target stroke in the audio information is played, displaying a labeling result of the error information of the target stroke.
In one possible embodiment, the first error information includes error information for at least one stroke;
the display module is used for displaying the comment information and the marking result of the handwriting information:
generating video information corresponding to the comment information based on the comment information;
and playing the video information in a preset position area of a current display interface, and displaying a marking result of error information of at least one stroke in a writing result corresponding to the writing handwriting information.
In a possible implementation manner, the display module, when playing the video information in a preset position area of a current display interface and displaying a labeling result of error information of at least one stroke in a writing result corresponding to the handwriting information, is configured to:
and when target video information corresponding to the error information of the target stroke in the video information is played, displaying the labeling result of the error information of the target stroke.
In a possible implementation manner, when the handwriting information corresponds to a plurality of words, the display module is further configured to:
responding to a trigger operation for any word;
and displaying the comment information corresponding to any character and the marking result of the handwriting information of any character.
In a third aspect, an embodiment of the present disclosure further provides a computer device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the computer device is running, the machine-readable instructions when executed by the processor performing the steps of the first aspect described above, or any possible implementation of the first aspect.
In a fourth aspect, this disclosed embodiment also provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps in the first aspect or any one of the possible implementation manners of the first aspect.
According to the handwriting detection method and device provided by the embodiment of the disclosure, after the handwriting information of the user is obtained, the first error information in the handwriting information can be directly determined, the comment information is automatically generated based on the first error information, the comment information is displayed, and the marking result of the handwriting information is displayed.
In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly described below, and the drawings herein incorporated in and forming a part of the specification illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure. It is appreciated that the following drawings depict only certain embodiments of the disclosure and are therefore not to be considered limiting of its scope, for those skilled in the art will be able to derive additional related drawings therefrom without the benefit of the inventive faculty.
FIG. 1 is a flow chart illustrating a method for handwriting detection provided by an embodiment of the present disclosure;
FIG. 2 is a flow chart illustrating a training method of a neural network in the handwriting detection method provided by the embodiment of the disclosure;
FIG. 3 is a flow chart illustrating one method of handwriting detection provided by the embodiment of the disclosure;
FIG. 4 is a schematic diagram illustrating a display of a labeling result in the handwriting detection method provided by the embodiment of the disclosure;
FIG. 5 is a flow chart illustrating another method in the handwriting detection method provided by the embodiment of the disclosure;
FIG. 6 is a schematic diagram illustrating an architecture of a handwriting detection apparatus provided in an embodiment of the present disclosure;
fig. 7 shows a schematic diagram of a computer device provided by an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure, presented in the figures, is not intended to limit the scope of the claimed disclosure, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making creative efforts, shall fall within the protection scope of the disclosure.
If the teacher or the parents supervise the calligraphy practicing process of the students, the supervising effect is possibly poor because the teacher needs to supervise more students and the parents possibly have insufficient understanding on the fonts; to improve angular efficiency. In the related art, in order to solve the problem that parents do not know the fonts sufficiently, images containing characters written by students are generally shot, then the images are sent to a teacher end, and the teacher end judges the characters.
In some technologies, the supervision of the calligraphy practicing process of the students can be realized based on the electronic equipment, however, the students can only be generally judged according to the writing results, for example, whether the students write correctly or not is judged, the student writing process cannot be supervised, so that the students cannot know the mistakes made in the writing process, and the supervision effect is poor.
Based on the research, the handwriting detection method and device provided by the embodiment of the disclosure can directly determine first error information in the handwriting information after the handwriting information of a user is obtained, automatically generate comment information based on the first error information, display the comment information and display a labeling result of the handwriting information, and the user can directly know the problem in the writing process according to the displayed comment information and the labeling result of the handwriting, so that the automatic comment of the handwriting information is realized, the efficiency and the precision of user supervision in the writing process are improved, and the labor cost is saved.
The above-mentioned drawbacks are the results of the inventor after practical and careful study, and therefore, the discovery process of the above-mentioned problems and the solutions proposed by the present disclosure to the above-mentioned problems should be the contribution of the inventor in the process of the present disclosure.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
In order to facilitate understanding of the embodiment, a handwriting detection method disclosed in the embodiment of the present disclosure is first described in detail, and an execution subject of the handwriting detection method provided in the embodiment of the present disclosure is generally a computer device with certain computing capability, where the computer device includes, for example: a terminal device, which may be a User Equipment (UE), a mobile device, a User terminal, a cellular phone, a cordless phone, a Personal Digital Assistant (PDA), a handheld device, a computing device, a vehicle mounted device, a wearable device, or a server or other processing device. In some possible implementations, the handwriting detection method may be implemented by a processor invoking computer readable instructions stored in a memory.
Referring to fig. 1, a flowchart of a handwriting detection method provided in the embodiment of the present disclosure is shown, where the method includes steps 101 to 104, where:
And 102, identifying first error information in the handwriting information of the user.
And 103, generating comment information aiming at the user based on the first error information.
And 104, displaying the comment information and a labeling result of the handwriting information, wherein the labeling result is labeled based on the first error information.
The following is a detailed description of the above steps.
For step 101,
The writing handwriting information of the user may include, for example, a writing result of each stroke when the user writes the target word, whether the target word is a target Chinese character, a writing sequence of each stroke, a relative position in a cell, a relative position between each stroke, a horizontal and vertical stroke, a completion degree, and the like.
In a possible implementation manner, the handwriting information may be handwriting information for a target word, for example, the target word to be trained may be set by the terminal device, or the target word to be trained may be displayed, and then after the handwriting information is obtained, the handwriting information is used as the handwriting information corresponding to the target word.
In one possible implementation, a user may write through an intelligent hardware device, where the intelligent hardware device may be a device that may obtain handwriting of the user, and may include, for example, a hardware device that directly writes on the device, such as an intelligent touch capacitive pen for writing on an electronic screen with touch functionality; for example, hardware devices for writing on paper exercise books, such as electromagnetic pens and writing pads; the present disclosure is not limited to other devices that can obtain handwriting information.
When obtaining writing information, use electromagnetic pen + handwriting board as an example, can write on the paper exercise book through the electromagnetic pen, the paper exercise book can be placed on the handwriting pad, and the user is after writing finishing, and the handwriting pad can obtain the writing information that the user wrote through the electromagnetic pen to will write writing information send to the computer equipment of carrying out this writing detection method that the disclosure provided.
When the handwriting information is sent to the computer device executing the handwriting detection method provided by the present disclosure, the handwriting board may be in a wired transmission mode and/or a wireless transmission mode, where the wireless transmission mode may include, for example, bluetooth transmission, wireless network transmission, and the like.
In a possible implementation manner, the handwriting information of the user can be obtained in real time, and also can be obtained after the user finishes writing. For example, after a user writes on a paper exercise book, the handwriting board can acquire handwriting information in real time and transmit the handwriting information to computer equipment executing the handwriting detection method provided by the disclosure; or the handwriting board acquires handwriting information in real time, and after the fact that a button for completing writing on the handwriting board is triggered is detected, the acquired handwriting information is sent to the computer equipment.
In another possible implementation manner, the handwriting board may acquire handwriting information in real time, and if the user does not continue writing within a preset time after writing, the handwriting board may be controlled to send the acquired handwriting information to the computer device.
In a possible implementation manner, if the computer device executing the method provided by the present disclosure is a terminal device with a display function, the writing information of the user may be obtained in real time during the writing process of the user, and the writing result of the user may be synchronously displayed on the terminal device based on the writing information.
For example, for the Chinese character "three", after the user writes the first bar on the paper exercise book, the terminal device may synchronously display the first bar written on the paper exercise book by the user.
With respect to step 102,
The first error information in the handwriting information comprises error information under at least one error type, and the error type comprises at least one of the following errors:
a font error, a writing process error, and a writing aesthetic error.
The glyph error may include, for example, a stroke-less writing, a writing-more writing, or an erroneous word, etc.
The writing process errors may include, for example, stroke order errors, writing direction errors, stroke writing errors, writing habit errors (e.g., continuous strokes, repeated writing of a certain stroke, etc.), and the like.
The writing aesthetic errors may include, for example, structural errors, stroke morphological errors, errors in the position of the target word in the cell, etc., wherein the resulting errors may include, for example, the distance, inclination, skew, magnitude relationship, etc., between the multiple components; the stroke morphology errors may include, for example, relationships between strokes, position, length, tilt, morphology, and the like.
Here, for example, for the chinese character "Ming", the components include a "day" for the left half and a "month" for the right half.
In one possible implementation, when first error information in the user's handwriting information is recognized, the recognition may be performed based on a pre-trained neural network.
Specifically, when the first error information in the handwriting information of the user is identified based on the pre-trained neural network, the handwriting information of the user may be input into the pre-trained neural network, and the neural network may output the first error information in the handwriting information.
The neural network can be obtained based on the sample handwriting information and error labeling training of the sample handwriting information.
Illustratively, the neural network may refer to the training method shown in fig. 2 when training, and includes the following steps:
202, inputting the sample handwriting information into a neural network to be trained to obtain prediction error information of the neural network;
and 203, determining a loss value in the training process based on the prediction error information and the error label of the sample handwriting information, and adjusting the network parameter value of the neural network in the training process under the condition that the loss value does not meet the preset condition.
For step 103,
In one possible implementation, writing state information of the user may be acquired, second error information of the writing state of the user may be determined based on the writing state information of the user, and when generating the comment information for the user, the comment information for the user may be generated based on the first error information and the second error information.
The writing state information of the user may include a pen-holding posture and/or a writing speed, and the pen-holding posture may include, for example, a distance between a position where the electromagnetic pen is held by the user and a pen point of the electromagnetic pen, and/or an inclination angle between the electromagnetic pen and the tablet during writing.
When the second error information of the writing state of the user is determined based on the writing state information of the user, for example, the second error information of the writing state of the user may be determined when it is detected that the distance between the position where the electromagnetic pen is held by the user and the pen point of the electromagnetic pen is not within the set distance range or the inclination angle between the electromagnetic pen and the writing board is not within the set angle range.
In one possible implementation, when generating the comment information for the user based on the first error information and the second error information, the first error information and the second error information may be spliced in a preset order to generate the comment information.
For example, if the target word is "bright", and the user writes "day" in the left half as "target" in the writing process, the first error information is "one more horizontal line in the left half", the distance between the position where the user holds the electromagnetic pen and the pen point of the electromagnetic pen is smaller than the minimum value of the set distance range, the second error information is "too low where the user holds the electromagnetic pen", and the generated comment information may be "one more horizontal line in the left half and too low where the user holds the electromagnetic pen" after the first error information and the second error information are spliced according to the preset sequence.
In another possible embodiment, when generating the comment information for the user based on the first error information and the second error information, the comment template for the user may be acquired first, and then the first error information and the second error information may be added to corresponding positions of the comment template to generate the comment information.
For example, when the number of the first error information and the second error information is detected to be less than a preset value, the template sentence of the comment template may include an awarding sentence, the awarding sentence may be "written very little wrong", and when the number of the first error information and the second error information is detected to be greater than the preset value, the template sentence of the comment template may include an encouraging sentence, the encouraging sentence may be "the question is compared much, and the next effort is continued", for example.
In one possible embodiment, the review template may illustratively be as follows:
lovely ones(0)The number of children is small, and the number of children,(1)；first, for(2) This word, (3), (4), (5);then in the aspect of writing gesture, the child(6)The next time these questions are noted, you expect you to do better!
In the comment template, (0) represents the user identity, (1) represents an encouragement sentence or an awarding sentence corresponding to the user, (2) represents target words, (3), (4) and (5) represent first error information, and (6) represents second error information, and blank positions corresponding to the first error information and the second error information can be matched with an actual detection result in actual application.
With respect to step 104,
When the method provided by the present disclosure is applied to a terminal device having a display function, step 104 may be performed by the terminal device; when the method provided by the present disclosure is applied to a server, it may be that the server controls a display device having a display function to perform step 104; when the method provided by the present disclosure is applied to a terminal device without a display function, it may be that the terminal device controls a display apparatus connected to the terminal device to perform step 104.
In one possible implementation, the first error information may include error information for at least one stroke; in one possible implementation, when displaying the comment information and the labeling result of the handwriting information, reference may be made to the displaying method shown in fig. 3, which includes the following steps:
Illustratively, when the audio information corresponding to the comment information is generated based on the comment information, the text information of the comment information may be converted into the corresponding audio information through a text-to-speech (TTS) system.
And 302, playing the audio information, and displaying a labeling result of error information of at least one stroke in a writing result corresponding to the writing handwriting information.
Specifically, at least one target audio information corresponding to the error information of the target stroke in the audio information may be determined, and then when the audio information is played, a labeling result of the error information of the target stroke may be displayed when the target audio information corresponding to the error information of the target stroke in the audio information is played.
In one possible embodiment, in executing step 103, the annotation result of the handwriting information may be determined synchronously based on the first error information. Specifically, the first error information includes error information for at least one stroke, so that each first error information may have a corresponding stroke, and when the handwriting information is labeled, the stroke in the writing result of the handwriting may be labeled.
Here, each stroke corresponding to the first error information may include a plurality of strokes, for example, the first two horizontal lines of the "raw" word should be parallel and inclined upward, and the first error information may be "the two horizontal lines are not parallel". For example, the result of labeling the handwriting information can be as shown in FIG. 4.
In another possible implementation, when displaying the comment information and the labeling result of the handwriting information, reference may also be made to the method shown in fig. 5, which includes the following steps:
and 501, generating video information corresponding to the comment information based on the comment information.
In a possible implementation manner, when video information corresponding to the comment information is generated based on the comment information, text-to-speech (TTS) system may be used to convert text information of the comment information into corresponding audio information, then an animation including a moving animation character may be configured for the audio information, for example, a parrot with a mouth opening may be configured, and then the animation and the audio information are fused to obtain the video information corresponding to the comment information.
Specifically, at least one piece of target video information corresponding to the error information of the target stroke in the video information may be determined, and then when the video information is played, a labeling result of the error information of the target stroke may be displayed when the target video information corresponding to the error information of the target stroke in the video information is played.
In a possible implementation manner, the video information and the annotation result may be displayed in different preset position areas of the current interface, for example, the video information may be displayed in a first preset position area of the current interface, and the annotation result may be displayed in a second preset position area.
In one possible embodiment, the handwriting information may be handwriting information corresponding to a plurality of words, and this includes two cases, one is handwriting information for a plurality of times of writing the same word, and the other is handwriting information for a single time of writing different words.
And under the condition that the handwriting information corresponds to a plurality of characters, responding to the trigger operation aiming at any character, and then displaying the comment information corresponding to the character and the labeling result of the handwriting of the character.
The handwriting information described herein corresponds to a plurality of words, and may include both of the above cases.
According to the handwriting detection method provided by the embodiment of the disclosure, after the handwriting information of the user is obtained, the first error information in the handwriting information can be directly determined, the comment information is automatically generated based on the first error information, the comment information is displayed, and the marking result of the handwriting information is displayed.
It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.
Based on the same inventive concept, the embodiment of the present disclosure further provides a handwriting detection apparatus corresponding to the handwriting detection method, and as the principle of the apparatus in the embodiment of the present disclosure for solving the problem is similar to the handwriting detection method in the embodiment of the present disclosure, the implementation of the apparatus may refer to the implementation of the method, and repeated parts are not described again.
Referring to fig. 6, which is a schematic diagram of an architecture of a handwriting detection apparatus provided in an embodiment of the present disclosure, the apparatus includes: an acquisition module 601, an identification module 602, a generation module 603 and a presentation module 604; wherein the content of the first and second substances,
an obtaining module 601, configured to obtain handwriting information of a user;
the recognition module is used for recognizing first error information in the handwriting information of the user;
a generating module 602, configured to generate comment information for the user based on the first error information;
a display module 603, configured to display the comment information and a labeling result of the handwriting information, where the labeling result is labeled based on the first error information.
In a possible embodiment, the first error information includes error information under at least one error type;
the error type includes at least one of the following errors:
a font error, a writing process error, and a writing aesthetic error.
In a possible implementation manner, the obtaining module 601 is further configured to obtain writing status information of the user;
the recognition module is further used for determining second error information of the writing state of the user based on the writing state information of the user;
the generating module 603, when generating the comment information for the user based on the first error information, is configured to:
generating comment information for the user based on the first error information and the second error information.
In one possible embodiment, the writing state information includes a pen-holding posture and/or a writing speed.
In a possible implementation, the generating module 603, when generating the comment information for the user based on the first error information and the second error information, is configured to:
and splicing the first error information and the second error information according to a preset sequence to generate the comment information.
In a possible implementation, the generating module 603, when generating the comment information for the user based on the first error information and the second error information, is configured to:
acquiring a comment template aiming at the user;
and adding the first error information and the second error information to corresponding positions of the commenting template to generate the commenting information.
In one possible embodiment, the first error information includes error information for at least one stroke;
the display module 604 is configured to, when displaying the comment information and the labeling result of the handwriting information,:
generating audio information corresponding to the comment information based on the comment information;
and playing the audio information and displaying a labeling result of error information of at least one stroke in a writing result corresponding to the handwriting information.
In a possible implementation manner, the presenting module 604, when playing the audio information and presenting the labeling result of the error information of at least one stroke in the writing result corresponding to the writing trace information, is configured to:
and when target audio information corresponding to the error information of the target stroke in the audio information is played, displaying a labeling result of the error information of the target stroke.
In one possible embodiment, the first error information includes error information for at least one stroke;
the display module 604 is configured to, when displaying the comment information and the labeling result of the handwriting information,:
generating video information corresponding to the comment information based on the comment information;
and playing the video information in a preset position area of a current display interface, and displaying a marking result of error information of at least one stroke in a writing result corresponding to the writing handwriting information.
In a possible implementation manner, the displaying module 604 is configured to, when playing the video information in a preset position area of a current display interface and displaying a labeling result of error information of at least one stroke in a writing result corresponding to the handwriting information, be configured to:
and when target video information corresponding to the error information of the target stroke in the video information is played, displaying the labeling result of the error information of the target stroke.
In a possible implementation manner, when the writing trace information corresponds to a plurality of words, the displaying module 604 is further configured to:
responding to a trigger operation for any word;
and displaying the comment information corresponding to any character and the marking result of the handwriting information of any character.
The description of the processing flow of each module in the device and the interaction flow between the modules may refer to the related description in the above method embodiments, and will not be described in detail here.
The handwriting detection device provided by the embodiment of the disclosure can directly determine first error information in the handwriting information after acquiring the handwriting information of a user, then automatically generate comment information based on the first error information, show the comment information, and label results of the handwriting information, and the user can directly know the problems in the writing process according to the displayed comment information and the label results of the handwriting, thereby realizing automatic comment on the handwriting information, improving the efficiency and precision of user supervision in the writing process, and saving the labor cost.
Based on the same technical concept, the embodiment of the disclosure also provides computer equipment. Referring to fig. 7, a schematic structural diagram of a computer device 700 provided in the embodiment of the present disclosure includes a processor 701, a memory 702, and a bus 703. The memory 702 is used for storing execution instructions and includes a memory 7021 and an external memory 7022; the memory 7021 is also referred to as an internal memory, and is used to temporarily store operation data in the processor 701 and data exchanged with an external memory 7022 such as a hard disk, the processor 701 exchanges data with the external memory 7022 through the memory 7021, and when the computer apparatus 700 is operated, the processor 701 communicates with the memory 702 through the bus 703, so that the processor 701 executes the following instructions:
acquiring writing information of a user;
identifying first error information in the handwriting information of the user;
generating comment information for the user based on the first error information;
and displaying the comment information and a labeling result of the handwriting information, wherein the labeling result is labeled based on the first error information.
In a possible implementation manner, in the instructions executed by the processor 701, the first error information includes error information in at least one error type;
the error type includes at least one of the following errors:
a font error, a writing process error, and a writing aesthetic error.
In a possible implementation manner, in the instructions executed by the processor 701, the method further includes:
acquiring writing state information of the user;
determining second error information of the writing state of the user based on the writing state information of the user;
the generating of the comment information for the user based on the first error information includes:
generating comment information for the user based on the first error information and the second error information.
In one possible embodiment, the writing state information includes a pen-holding posture and/or a writing speed in the instructions executed by the processor 701.
In a possible implementation, the generating of the comment information for the user based on the first error information and the second error information in the instructions executed by the processor 701 includes:
and splicing the first error information and the second error information according to a preset sequence to generate the comment information.
In a possible implementation, the generating of the comment information for the user based on the first error information and the second error information in the instructions executed by the processor 701 includes:
acquiring a comment template aiming at the user;
and adding the first error information and the second error information to corresponding positions of the commenting template to generate the commenting information.
In a possible implementation, in the instructions executed by the processor 701, the first error information includes error information for at least one stroke;
the displaying the comment information and the labeling result of the handwriting information comprise:
generating audio information corresponding to the comment information based on the comment information;
and playing the audio information and displaying a labeling result of error information of at least one stroke in a writing result corresponding to the handwriting information.
In a possible implementation manner, in the instructions executed by the processor 701, the playing the audio information and the labeling result showing the error information of at least one stroke in the writing result corresponding to the writing trace information include:
and when target audio information corresponding to the error information of the target stroke in the audio information is played, displaying a labeling result of the error information of the target stroke.
In a possible implementation, in the instructions executed by the processor 701, the first error information includes error information for at least one stroke;
displaying the comment information and a labeling result of the handwriting information, wherein the displaying comprises the following steps:
generating video information corresponding to the comment information based on the comment information;
and playing the video information in a preset position area of a current display interface, and displaying a marking result of error information of at least one stroke in a writing result corresponding to the writing handwriting information.
In a possible implementation manner, in the instructions executed by the processor 701, the playing the video information in the preset position area of the current display interface and displaying the labeling result of the error information of at least one stroke in the writing result corresponding to the writing trace information include:
and when target video information corresponding to the error information of the target stroke in the video information is played, displaying the labeling result of the error information of the target stroke.
In one possible implementation, in the instructions executed by the processor 701, when the writing information corresponds to a plurality of words, the method further includes:
responding to a trigger operation for any word;
and displaying the comment information corresponding to any character and the marking result of the handwriting information of any character.
The embodiments of the present disclosure also provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program performs the steps of the handwriting detection method described in the above method embodiments. The storage medium may be a volatile or non-volatile computer-readable storage medium.
The embodiments of the present disclosure also provide a computer program product, where the computer program product bears a program code, and instructions included in the program code may be used to execute steps of the handwriting detection method in the foregoing method embodiments, which may be referred to specifically for the foregoing method embodiments, and are not described herein again.
The computer program product may be implemented by hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are merely specific embodiments of the present disclosure, which are used for illustrating the technical solutions of the present disclosure and not for limiting the same, and the scope of the present disclosure is not limited thereto, and although the present disclosure is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive of the technical solutions described in the foregoing embodiments or equivalent technical features thereof within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present disclosure, and should be construed as being included therein. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
Claims (14)
1. A handwriting detection method, comprising:
acquiring writing information of a user;
identifying first error information in the handwriting information of the user;
generating comment information for the user based on the first error information;
and displaying the comment information and a labeling result of the handwriting information, wherein the labeling result is labeled based on the first error information.
2. The method of claim 1, wherein the first error information comprises error information in at least one error type;
the error type includes at least one of the following errors:
a font error, a writing process error, and a writing aesthetic error.
3. The method of claim 1, further comprising:
acquiring writing state information of the user;
determining second error information of the writing state of the user based on the writing state information of the user;
the generating of the comment information for the user based on the first error information includes:
generating comment information for the user based on the first error information and the second error information.
4. The method of claim 3, wherein the writing state information comprises a pen-holding gesture and/or a writing speed.
5. The method of claim 3, wherein generating criticizing information for the user based on the first error information and the second error information comprises:
and splicing the first error information and the second error information according to a preset sequence to generate the comment information.
6. The method of claim 4, wherein generating criticizing information for the user based on the first error information and the second error information comprises:
acquiring a comment template aiming at the user;
and adding the first error information and the second error information to corresponding positions of the commenting template to generate the commenting information.
7. The method of claim 1, wherein the first error information comprises error information for at least one stroke;
the displaying the comment information and the labeling result of the handwriting information comprise:
generating audio information corresponding to the comment information based on the comment information;
and playing the audio information and displaying a labeling result of error information of at least one stroke in a writing result corresponding to the handwriting information.
8. The method according to claim 7, wherein the playing the audio information and displaying the labeling result of the error information of at least one stroke in the writing result corresponding to the writing trace information comprises:
and when target audio information corresponding to the error information of the target stroke in the audio information is played, displaying a labeling result of the error information of the target stroke.
9. The method of claim 1, wherein the first error information comprises error information for at least one stroke;
displaying the comment information and a labeling result of the handwriting information, wherein the displaying comprises the following steps:
generating video information corresponding to the comment information based on the comment information;
and playing the video information in a preset position area of a current display interface, and displaying a marking result of error information of at least one stroke in a writing result corresponding to the writing handwriting information.
10. The method according to claim 9, wherein the playing the video information in a preset position area of a current display interface and displaying a labeling result of error information of at least one stroke in a writing result corresponding to the handwriting information comprises:
and when target video information corresponding to the error information of the target stroke in the video information is played, displaying the labeling result of the error information of the target stroke.
11. The method of claim 1, wherein when the writing information corresponds to a plurality of words, the method further comprises:
responding to a trigger operation for any word;
and displaying the comment information corresponding to any character and the marking result of the handwriting information of any character.
12. A handwriting detection apparatus, comprising:
the acquisition module is used for acquiring handwriting information of a user;
the recognition module is used for recognizing first error information in the handwriting information of the user;
a generation module configured to generate comment information for the user based on the first error information;
and the display module is used for displaying the comment information and a labeling result of the handwriting information, wherein the labeling result is labeled based on the first error information.
13. A computer device, comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over the bus when a computer device is run, the machine-readable instructions when executed by the processor performing the steps of the handwriting detection method according to any of claims 1 to 11.
14. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the method for handwriting detection according to any one of claims 1 to 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011446028.XA CN112446349A (en) | 2020-12-09 | 2020-12-09 | Handwriting detection method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011446028.XA CN112446349A (en) | 2020-12-09 | 2020-12-09 | Handwriting detection method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112446349A true CN112446349A (en) | 2021-03-05 |
Family
ID=74739034
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011446028.XA Pending CN112446349A (en) | 2020-12-09 | 2020-12-09 | Handwriting detection method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112446349A (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070222770A1 (en) * | 1999-05-25 | 2007-09-27 | Silverbrook Research Pty Ltd | Recording and Communication of Handwritten Information |
| CN101101706A (en) * | 2006-07-05 | 2008-01-09 | 香港理工大学 | Chinese writing study machine and Chinese writing study method |
| CN104050453A (en) * | 2014-06-24 | 2014-09-17 | 南京师范大学 | Evaluation method for handwritten Chinese character handwriting |
| CN105321399A (en) * | 2014-08-29 | 2016-02-10 | 广东小天才科技有限公司 | Brush calligraphy practicing apparatus, conductive brush and brush calligraphy practicing system |
| CN107301803A (en) * | 2017-06-29 | 2017-10-27 | 广东小天才科技有限公司 | A kind of order of strokes observed in calligraphy correcting method, device, terminal device and computer-readable storage medium |
| CN107609575A (en) * | 2017-08-21 | 2018-01-19 | 北京华文众合科技有限公司 | Calligraphy evaluation method, calligraphy evaluating apparatus and electronic equipment |
| CN109543777A (en) * | 2018-11-28 | 2019-03-29 | 中国科学院自动化研究所 | Handwritten Chinese character writing quality evaluation method and system |
| CN110222671A (en) * | 2019-06-19 | 2019-09-10 | 南京孜博汇信息科技有限公司 | The method and system that point reading based on dot matrix is write |
| CN110555403A (en) * | 2019-08-29 | 2019-12-10 | 韶关市启之信息技术有限公司 | handwritten character evaluation method and system |
| CN110796131A (en) * | 2019-10-31 | 2020-02-14 | 黑龙江文茁教育科技有限公司 | Chinese character writing evaluation system |
| CN111523455A (en) * | 2020-04-22 | 2020-08-11 | 北京易文汉学科技有限公司 | Evaluation method for Chinese character writing |
-
2020
- 2020-12-09 CN CN202011446028.XA patent/CN112446349A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070222770A1 (en) * | 1999-05-25 | 2007-09-27 | Silverbrook Research Pty Ltd | Recording and Communication of Handwritten Information |
| CN101101706A (en) * | 2006-07-05 | 2008-01-09 | 香港理工大学 | Chinese writing study machine and Chinese writing study method |
| CN104050453A (en) * | 2014-06-24 | 2014-09-17 | 南京师范大学 | Evaluation method for handwritten Chinese character handwriting |
| CN105321399A (en) * | 2014-08-29 | 2016-02-10 | 广东小天才科技有限公司 | Brush calligraphy practicing apparatus, conductive brush and brush calligraphy practicing system |
| CN107301803A (en) * | 2017-06-29 | 2017-10-27 | 广东小天才科技有限公司 | A kind of order of strokes observed in calligraphy correcting method, device, terminal device and computer-readable storage medium |
| CN107609575A (en) * | 2017-08-21 | 2018-01-19 | 北京华文众合科技有限公司 | Calligraphy evaluation method, calligraphy evaluating apparatus and electronic equipment |
| CN109543777A (en) * | 2018-11-28 | 2019-03-29 | 中国科学院自动化研究所 | Handwritten Chinese character writing quality evaluation method and system |
| CN110222671A (en) * | 2019-06-19 | 2019-09-10 | 南京孜博汇信息科技有限公司 | The method and system that point reading based on dot matrix is write |
| CN110555403A (en) * | 2019-08-29 | 2019-12-10 | 韶关市启之信息技术有限公司 | handwritten character evaluation method and system |
| CN110796131A (en) * | 2019-10-31 | 2020-02-14 | 黑龙江文茁教育科技有限公司 | Chinese character writing evaluation system |
| CN111523455A (en) * | 2020-04-22 | 2020-08-11 | 北京易文汉学科技有限公司 | Evaluation method for Chinese character writing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10606474B2 (en) | Touch screen finger tracing device | |
| US8358320B2 (en) | Interactive transcription system and method | |
| CN101101706A (en) | Chinese writing study machine and Chinese writing study method | |
| CN102855082A (en) | Character recognition for overlapping textual user input | |
| Taele et al. | Lamps: A sketch recognition-based teaching tool for mandarin phonetic symbols i | |
| CN104199834A (en) | Method and system for interactively obtaining and outputting remote resources on surface of information carrier | |
| CN105139311A (en) | Intelligent terminal based English teaching system | |
| JP6963302B2 (en) | Kanji learning device | |
| Taele et al. | BopoNoto: An Intelligent Sketch Education Application for Learning Zhuyin Phonetic Script. | |
| CN110888549B (en) | Handwriting practicing method, system, equipment and storage medium based on touch equipment | |
| KR20180015515A (en) | Method and system for learning languages using a smart pen | |
| CN112149680A (en) | Wrong word detection and identification method and device, electronic equipment and storage medium | |
| US20150269863A1 (en) | Method, Device, and System for Teaching Cursive Writing | |
| CN116758786A (en) | Handwriting evaluation method and device, computer equipment and medium | |
| Jayakumar et al. | Integrating writing direction and handwriting letter recognition in touch-enabled devices | |
| Bezine et al. | Development of an Arabic handwriting learning educational system | |
| CN112446349A (en) | Handwriting detection method and device | |
| Margetis et al. | A smart environment for augmented learning through physical books | |
| CN110766997A (en) | Copy display method, device and storage medium | |
| CN115294573A (en) | Job correction method, device, equipment and medium | |
| CN110851071A (en) | Handwriting data processing and acquiring method and device | |
| Taele et al. | An intelligent sketch-based educational interface for learning complex written east asian phonetic symbols | |
| Taele | Freehand sketch recognition for computer-assisted language learning of written east asian languages | |
| Al-Barhamtoshy et al. | A Toolkit for Teaching Arabic Handwriting | |
| Kotak et al. | An accelerometer based handwriting recognition of English alphabets using basic strokes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210305 |
|
| RJ01 | Rejection of invention patent application after publication |