CN116798047A - Teaching blackboard writing analysis method and system based on image recognition - Google Patents
Teaching blackboard writing analysis method and system based on image recognition Download PDFInfo
- Publication number
- CN116798047A CN116798047A CN202310511676.6A CN202310511676A CN116798047A CN 116798047 A CN116798047 A CN 116798047A CN 202310511676 A CN202310511676 A CN 202310511676A CN 116798047 A CN116798047 A CN 116798047A
- Authority
- CN
- China
- Prior art keywords
- blackboard
- writing
- result
- image
- analysis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004458 analytical method Methods 0.000 title claims abstract description 196
- 238000012545 processing Methods 0.000 claims abstract description 85
- 230000000007 visual effect Effects 0.000 claims abstract description 43
- 238000011156 evaluation Methods 0.000 claims abstract description 40
- 238000013461 design Methods 0.000 claims abstract description 34
- 238000004364 calculation method Methods 0.000 claims abstract description 23
- 238000007405 data analysis Methods 0.000 claims abstract description 19
- 238000012216 screening Methods 0.000 claims abstract description 16
- 238000000034 method Methods 0.000 claims description 21
- 238000010835 comparative analysis Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 5
- 230000008569 process Effects 0.000 claims description 5
- 238000012800 visualization Methods 0.000 claims description 5
- 230000006872 improvement Effects 0.000 claims description 4
- 238000012854 evaluation process Methods 0.000 claims 1
- 230000006870 function Effects 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000006467 substitution reaction Methods 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000007635 classification algorithm Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/19—Recognition using electronic means
- G06V30/191—Design or setup of recognition systems or techniques; Extraction of features in feature space; Clustering techniques; Blind source separation
- G06V30/19173—Classification techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/761—Proximity, similarity or dissimilarity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/94—Hardware or software architectures specially adapted for image or video understanding
- G06V10/95—Hardware or software architectures specially adapted for image or video understanding structured as a network, e.g. client-server architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/16—Image preprocessing
- G06V30/166—Normalisation of pattern dimensions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/16—Image preprocessing
- G06V30/168—Smoothing or thinning of the pattern; Skeletonisation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Artificial Intelligence (AREA)
- Image Analysis (AREA)
Abstract
The application discloses a teaching blackboard writing analysis method and a system based on image recognition, wherein the system acquires a teaching blackboard writing image through a first module; screening the teaching board writing images through a second module to obtain board writing images to be analyzed; performing image recognition processing on the to-be-analyzed blackboard-writing image through a third module, and performing skill parameter calculation processing on the to-be-analyzed blackboard-writing image according to the recognition result to obtain a blackboard-writing image data analysis result; comparing analysis results of the blackboard-writing image data with preset parameters through a fourth module, and evaluating the blackboard-writing image to be analyzed according to the comparison analysis results to obtain evaluation results; the fifth module is used for carrying out visual display processing on the analysis result and the evaluation result of the blackboard-writing image data to obtain a visual result; and generating an blackboard writing design analysis report through a sixth module. The embodiment of the application improves the objectivity of analysis by intelligently analyzing the blackboard-writing image, and can be widely applied to the technical field of computer vision.
Description
Technical Field
The application relates to the technical field of computer vision, in particular to a teaching blackboard writing analysis method and system based on image recognition.
Background
With the development of science and technology, many modern teaching means have gone into the class, but blackboard writing still plays an irreplaceable role in teaching. The teaching blackboard writing can transfer information for a long time, has great flexibility and has demonstration and aesthetic effects. The composition of the blackboard writing content directly influences the quality of the blackboard writing and the teaching effect, so that analysis and evaluation of the blackboard writing and design level in the teaching are required. However, in the related art, the analysis method is mainly performed based on a subjective experience scoring mode by expert judges, and the problems of high artificial dependence, low efficiency, subjectivity difference and the like exist. In view of the foregoing, there is a need for solving the technical problems in the related art.
Disclosure of Invention
In view of the above, the embodiment of the application provides a teaching blackboard writing analysis method and a teaching blackboard writing analysis system based on image recognition, so as to realize intelligent analysis of the teaching blackboard writing.
In one aspect, the application provides an image recognition-based teaching blackboard writing analysis system, which is characterized by comprising:
the first module is used for acquiring a teaching blackboard writing image;
the second module is used for screening the teaching blackboard-writing images to obtain the blackboard-writing images to be analyzed;
the third module is used for carrying out image recognition processing on the to-be-analyzed blackboard-writing image, carrying out skill parameter calculation processing on the to-be-analyzed blackboard-writing image according to a recognition result to obtain a blackboard-writing image data analysis result, wherein the skill parameters comprise font standardization, writing regularity, layout equilibrium and color quantity;
the fourth module is used for comparing the analysis result of the blackboard-writing image data with preset parameters, and evaluating the blackboard-writing image to be analyzed according to the comparison analysis result to obtain an evaluation result;
the fifth module is used for carrying out visual display processing on the analysis result and the evaluation result of the blackboard-writing image data to obtain a visual result;
and a sixth module for generating an blackboard writing design analysis report according to the visual result.
Optionally, the first module is configured to obtain an image of a teaching blackboard writing, and includes:
acquiring a teaching blackboard writing image or a teaching video clip uploaded by a client;
and carrying out image interception processing on the teaching video clip to obtain a teaching blackboard writing image.
Optionally, the second module is configured to perform screening processing on the teaching blackboard-writing image to obtain a blackboard-writing image to be analyzed, and includes:
performing image classification processing on the teaching blackboard writing image to obtain a classification result;
performing definition analysis processing on the teaching blackboard-writing image according to the classification result to obtain a definition analysis result;
and screening the teaching blackboard-writing image according to the definition analysis result to obtain the blackboard-writing image to be analyzed.
Optionally, the third module is configured to perform image recognition processing on the to-be-analyzed board book image, and perform skill parameter calculation processing on the to-be-analyzed board book image according to a recognition result, to obtain a board book image data analysis result, where the third module includes:
performing image recognition processing on the to-be-analyzed blackboard-writing image to obtain a recognition font;
performing similarity calculation processing on the identification fonts according to preset standard fonts, and performing font standardization analysis processing on the to-be-analyzed blackboard-writing image according to the calculated similarity to obtain a first analysis result;
performing font regularity analysis processing on the to-be-analyzed blackboard-writing image according to the coordinate parameters of the identified fonts to obtain a second analysis result;
performing image entropy calculation on the to-be-analyzed blackboard-writing image, and performing layout equilibrium analysis processing on the to-be-analyzed blackboard-writing image according to an image entropy calculation result to obtain a third analysis result;
performing color space value extraction processing on the identification fonts, and performing color quantity analysis processing on the blackboard-writing image to be analyzed according to the extracted color space values to obtain a fourth analysis result;
and determining the first analysis result, the second analysis result, the third analysis result and the fourth analysis result as board writing image data analysis results.
Optionally, the fourth module is configured to perform comparative analysis processing on the analysis result of the blackboard-writing image data and a preset parameter, and perform evaluation processing on the blackboard-writing image to be analyzed according to the comparative analysis result, so as to obtain an evaluation result, where the evaluation result includes:
comparing the analysis result of the blackboard-writing image data with preset parameters to obtain a comparison analysis result;
and scoring the to-be-analyzed blackboard-writing image according to the comparison analysis result, and giving out improvement suggestions according to the scoring result to obtain an evaluation result.
Optionally, the fifth module is configured to perform visual display processing on the analysis result and the evaluation result of the blackboard-writing image data to obtain a visual result, and includes:
and carrying out visual display on the parameter values and the distribution ranges of the analysis results of the blackboard-writing image data according to the evaluation results to obtain visual results.
Optionally, the sixth module is configured to generate an blackboard writing design analysis report according to the visualization result, and includes:
analyzing and processing the visual result according to a preset output report period to obtain a period analysis result;
and carrying out design level characteristic parameter analysis processing according to the period analysis result to generate an blackboard writing design analysis report.
On the other hand, the embodiment of the application also provides a teaching blackboard writing analysis method based on image recognition, which comprises the following steps:
acquiring a teaching blackboard writing image;
screening the teaching blackboard-writing image to obtain a blackboard-writing image to be analyzed;
performing image recognition processing on the to-be-analyzed blackboard-writing image, and performing skill parameter calculation processing on the to-be-analyzed blackboard-writing image according to a recognition result to obtain a blackboard-writing image data analysis result, wherein the skill parameters comprise font standardization, writing regularity, layout equilibrium and color quantity;
comparing the analysis result of the blackboard-writing image data with preset parameters, and evaluating the blackboard-writing image to be analyzed according to the comparison analysis result to obtain an evaluation result;
performing visual display processing on the analysis result and the evaluation result of the blackboard-writing image data to obtain a visual result;
and generating an blackboard writing design analysis report according to the visual result.
On the other hand, the embodiment of the application also discloses electronic equipment, which comprises a processor and a memory;
the memory is used for storing programs;
the processor executes the program to implement the method as described above.
In another aspect, embodiments of the present application also disclose a computer readable storage medium storing a program for execution by a processor to implement a method as described above.
In another aspect, embodiments of the present application also disclose a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The computer instructions may be read from a computer-readable storage medium by a processor of a computer device, and executed by the processor, to cause the computer device to perform the foregoing method.
Compared with the prior art, the technical scheme provided by the application has the following technical effects: according to the embodiment of the application, the technical parameter calculation processing is carried out on the board book image to obtain the board book image data analysis result, four technical parameters including the font standardization, the writing regularity, the layout equilibrium and the color number of the board book image can be intelligently analyzed, and the subjectivity judgment difference is reduced. In addition, the embodiment of the application also carries out evaluation processing on the analysis result, and records and presents the design and writing skill condition of the blackboard writing image through visualization and generation of the blackboard writing design analysis report. The embodiment of the application can solve the problem that the analysis dimension is not comprehensive and objective due to the fact that the teaching board writing design is evaluated manually.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a teaching blackboard writing analysis system based on image recognition according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a font standardization analysis result provided by an embodiment of the present application;
fig. 3 is a schematic view of a result of analysis of writing regularity according to an embodiment of the present application.
FIG. 4 is a visual illustration of a layout equalization analysis result provided by an embodiment of the present application;
fig. 5 is a schematic view of a visualization of a color quantity analysis result provided by an embodiment of the present application.
Detailed Description
The present application will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present application more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.
In the related art, the evaluation of the writing and design level in teaching is mainly performed based on the manner that expert judges score according to subjective experience, and the problems of high artificial dependence, low efficiency, large subjectivity difference and the like exist. Therefore, the application provides a teaching blackboard writing analysis system based on image recognition, which is used for realizing automatic recognition, processing, analysis, scoring and evaluation of teaching blackboard writing.
In view of this, referring to fig. 1, an embodiment of the present application provides a teaching blackboard writing analysis system based on image recognition, including:
s101, a first module is used for acquiring a teaching blackboard writing image;
s102, a second module is used for screening the teaching blackboard-writing image to obtain a blackboard-writing image to be analyzed;
s103, a third module is used for carrying out image recognition processing on the to-be-analyzed blackboard-writing image, carrying out skill parameter calculation processing on the to-be-analyzed blackboard-writing image according to a recognition result, and obtaining a blackboard-writing image data analysis result, wherein the skill parameters comprise font standardization, writing regularity, layout equilibrium and color quantity;
s104, a fourth module is used for comparing analysis results of the blackboard-writing image data with preset parameters, and evaluating the blackboard-writing image to be analyzed according to the comparison analysis results to obtain evaluation results;
s105, a fifth module is used for carrying out visual display processing on the analysis result and the evaluation result of the blackboard-writing image data to obtain a visual result;
s106, a sixth module is used for generating an blackboard writing design analysis report according to the visual result.
Referring to fig. 1, in an embodiment of the present application, the teaching blackboard writing analysis system can be applied to a teaching environment, and intelligent analysis is performed on teaching blackboard writing images based on an image recognition technology or a computer vision technology. The method comprises the steps that a teaching blackboard-writing image is obtained through a first module, wherein the teaching blackboard-writing image is a teaching blackboard-writing image uploaded by a user, the teaching blackboard-writing image is obtained through a photo, a screenshot and the like, and the teaching blackboard-writing image is uploaded to a cloud server for storage. And screening the uploaded teaching board book image through the second module, judging whether the analysis uploading image meets the analysis requirement, if so, judging whether the analysis uploading image is the teaching board book image, whether the definition of the image meets the analysis requirement, and the like, so that other modules can analyze and process conveniently. And when the teaching board writing image meets the analysis requirement, obtaining the board writing image to be analyzed through screening treatment. It is conceivable that if the uploaded image does not meet the analysis requirement, the system of the embodiment of the present application also gives a corresponding prompt to ask the user to upload the image again. And extracting an image of the blackboard-writing to be analyzed from the cloud server through a third module, and identifying the image of the blackboard-writing to be analyzed through an image identification technology to obtain an identification result. The recognition result comprises the whole image recognition of the board book image and the recognition of fonts, such as the recognition result of the size, the color and the like of the fonts in the image, the layout recognition result of the image and the like. And carrying out skill parameter calculation processing on the board image to be analyzed according to the identification result, wherein the skill parameter calculation processing comprises font standardization, writing regularity, layout equilibrium and color quantity, and analyzing four parameter characteristics of the font standardization, writing regularity, layout equilibrium and color quantity in the board image to obtain board image data analysis results, and the board image data analysis results comprise font standardization analysis results, writing regularity analysis results, layout equilibrium analysis results and color quantity analysis results, as shown in fig. 2-5. According to the embodiment of the application, the fourth module is used for comparing the analysis result of the board writing image data with the preset parameters, and evaluating the board writing image to be analyzed according to the comparison analysis result to obtain the evaluation result. The preset parameters can be set according to actual conditions, for example, in color quantity analysis results, the corresponding preset parameters can be set to be 3, the color quantity analysis results are compared with the preset parameters, and the board writing images to be analyzed are evaluated according to different comparison analysis results to obtain evaluation results. It is conceivable that the system of the embodiment of the application automatically diagnoses problems and causes existing in the board writing image according to the comparison analysis result and provides improved advice. In addition, the embodiment of the application also carries out visual display processing on the analysis result and the evaluation result of the blackboard-writing image data through the fifth module to obtain a visual result, and the visual display can be carried out through modes of a mobile terminal, a television screen and the like, wherein the display modes comprise modes of charts and the like, and corresponding designs can be carried out according to actual conditions. The embodiment of the application also generates the blackboard-writing design analysis report corresponding to the teaching blackboard-writing image according to the visual result through the sixth module, and the blackboard-writing design analysis generates the visual result in a file report form and can be stored in a server side or a client side.
Therefore, the system of the embodiment of the application inputs the cloud-stored blackboard-writing image data to the skill parameter module, identifies, processes, analyzes and evaluates the user blackboard-writing image, and visually presents the analysis result. The system also identifies parameter values of four skills of the user board writing image in font standardization, writing regularity, layout equilibrium and color quantity, diagnoses and feeds back problems existing in board writing design of the user by comparing the parameter values with standard skill parameters, gives corresponding lifting suggestions, improves pertinence and accuracy of board writing skill training, and can help the user to improve efficiency of board writing design skill training.
Further as a preferred embodiment, the first module is configured to acquire an image of a teaching blackboard writing, and includes:
acquiring a teaching blackboard writing image or a teaching video clip uploaded by a client;
and carrying out image interception processing on the teaching video clip to obtain a teaching blackboard writing image.
In the embodiment of the application, the first module is used for acquiring the teaching blackboard writing image or the teaching video clip uploaded by the user at the client. According to the embodiment of the application, the teaching video clip can be subjected to image interception to obtain the corresponding teaching blackboard writing image, and the teaching blackboard writing image can be stored in the cloud server.
Further as a preferred embodiment, the second module is configured to perform screening processing on the teaching board writing image to obtain a board writing image to be analyzed, and includes:
performing image classification processing on the teaching blackboard writing image to obtain a classification result;
performing definition analysis processing on the teaching blackboard-writing image according to the classification result to obtain a definition analysis result;
and screening the teaching blackboard-writing image according to the definition analysis result to obtain the blackboard-writing image to be analyzed.
In the embodiment of the application, the second module is used for automatically screening whether the uploaded teaching board book image meets the analysis requirement or not so as to facilitate the next analysis. The image classification algorithm can be adopted to carry out image classification processing on the teaching blackboard-writing image, the type of the uploaded teaching blackboard-writing image is calculated, and an array of the teaching blackboard-writing image containing different types of probabilities is obtained. For example, the output array is [ a, b, c ], which means that the probability that the image belongs to the category 1 is a, the probability that the image belongs to the category 2 is b, the probability that the image belongs to the category 3 is c, the highest probability is taken as the image category, and then the type of the image is judged and the classification result is output. The image categories comprise an blackboard-writing category, a portrait category, a propaganda slogan category and the like, and when the image categories outside the blackboard-writing are output, the system can automatically judge and give a prompt. When the output classification result is an blackboard-writing image, the teaching blackboard-writing image is subjected to definition analysis processing to obtain a definition analysis result, and the second derivative of the blackboard-writing image is calculated by using the Laplacian operator. The second derivative of the blackboard writing image is used for reflecting the edge information of the image, and when the image of the same thing is the image, the variance of the image which is filtered by the Laplacian and corresponds to the image with high definition is larger. If the blackboard-writing image meets the definition requirement, the analysis can be performed, and then the next step of data analysis is performed; if the image is not clear and analysis cannot be supported, the system can automatically prompt the user to upload the blackboard-writing image again. It is conceivable that a definition parameter may be preset in the embodiment of the present application, so as to determine the definition of the image, and when the definition parameter is greater than or equal to the definition parameter, the blackboard-writing image may meet the definition requirement for further analysis.
Further as a preferred embodiment, the third module is configured to perform image recognition processing on the to-be-analyzed board writing image, and perform skill parameter calculation processing on the to-be-analyzed board writing image according to a recognition result, to obtain a board writing image data analysis result, where the third module includes:
performing image recognition processing on the to-be-analyzed blackboard-writing image to obtain a recognition font;
performing similarity calculation processing on the identification fonts according to preset standard fonts, and performing font standardization analysis processing on the to-be-analyzed blackboard-writing image according to the calculated similarity to obtain a first analysis result;
performing font regularity analysis processing on the to-be-analyzed blackboard-writing image according to the coordinate parameters of the identified fonts to obtain a second analysis result;
performing image entropy calculation on the to-be-analyzed blackboard-writing image, and performing layout equilibrium analysis processing on the to-be-analyzed blackboard-writing image according to an image entropy calculation result to obtain a third analysis result;
performing color space value extraction processing on the identification fonts, and performing color quantity analysis processing on the blackboard-writing image to be analyzed according to the extracted color space values to obtain a fourth analysis result;
and determining the first analysis result, the second analysis result, the third analysis result and the fourth analysis result as board writing image data analysis results.
In the embodiment of the application, the third module outputs the analysis result of the blackboard-writing image data, and the system automatically calculates four skill parameters of font standardization, writing regularity, layout equilibrium and color number through a deep learning algorithm and an image recognition technology. According to the embodiment of the application, firstly, an image recognition processing is carried out on an image of an blackboard-writing to be analyzed to obtain a recognized font, the system carries out processing such as position standardization and size unification, extraction of a Chinese character skeleton and the like on the recognized font according to the content of the recognized blackboard-writing font, compares the blackboard-writing font with a preset standard font, calculates a characteristic vector cosine value, obtains the duty ratio of the integral blackboard-writing standard font on the basis of calculating the similarity, and finally outputs a blackboard-writing font standardization result, namely a first analysis result. It is conceivable that the preset standard fonts in the embodiment of the present application may be corresponding Chinese characters in the regular script library, or may use corresponding characters in other font libraries, including arabic numerals or english symbols, etc. Then, on the basis of font identification, the embodiment of the application automatically calculates the length and width of each font and the corresponding coordinate parameters to obtain the row and column spacing and the gradient of the font, thereby carrying out font regularity analysis processing on the to-be-analyzed blackboard-writing image to obtain a second analysis result, namely a font regularity analysis result. The embodiment of the application also carries out image entropy calculation on the blackboard-writing image to be analyzed, and judges the density degree of each information block in the image by adopting the image entropy so as to analyze the layout equilibrium of the blackboard-writing image to be analyzed, thereby obtaining a third analysis result, namely a layout equilibrium analysis result. The image entropy is a statistical form of characteristics, and reflects the average information amount in the image. It is contemplated that the present embodiment may also visually present the number of information blocks and their quadrants on the right display interface of the system. The embodiment of the application also carries out color space value extraction processing on the identified fonts through the fourth module, extracts the color space value of each font pixel point, thereby judging the color of the pixel point and the number thereof, and obtaining a fourth analysis result, namely a color number analysis result. It is contemplated that the present implementation may visually present its number of blackboard writing colors on the right display interface of the system. And finally, summarizing the first analysis result, the second analysis result, the third analysis result and the fourth analysis result into an blackboard-writing image data analysis result, and transmitting the blackboard-writing image data analysis result to a next module for processing.
Further as a preferred embodiment, the fourth module is configured to perform comparative analysis processing on the analysis result of the board writing image data and a preset parameter, and perform evaluation processing on the board writing image to be analyzed according to the comparative analysis result, so as to obtain an evaluation result, where the evaluation result includes:
comparing the analysis result of the blackboard-writing image data with preset parameters to obtain a comparison analysis result;
and scoring the to-be-analyzed blackboard-writing image according to the comparison analysis result, and giving out improvement suggestions according to the scoring result to obtain an evaluation result.
In the embodiment of the application, the fourth module is used for carrying out comparative analysis processing on the analysis result of the blackboard-writing image data and the preset parameters to obtain a comparative analysis result; and scoring the board writing image to be analyzed according to the comparison analysis result, and giving out improvement suggestions according to the scoring result to obtain an evaluation result. Specifically, the preset parameters should be flexibly designed according to the actual scene, for example, in the analysis result of the font standardization, the system can display the standardization fraction and the average division thereof, and when the standardization fraction of the font is less than 60, the system is regarded as non-standardization and can remind the user of correction; in the writing regularity analysis result, when the row and column spacing exceeds 80% -160% of a reasonable value range and the inclination exceeds 5%, the system displays a prompt so as to be convenient for a user to adjust; in the layout equilibrium analysis result, the system can output the information block ratio and the initial position thereof, and when the number of the information blocks exceeds/is insufficient, the system gives a prompt; in the aspect of font color, the system outputs the color quantity of the blackboard writing according to the color quantity evaluation standard, and when the color quantity is less than 3, the system is regarded as single in color, and the system prompts the user to carry out color supplement. When more than 4 colors are considered to be too many, the system may suggest to the user to reduce the color usage.
Further as a preferred embodiment, the fifth module is configured to perform a visual display process on the analysis result and the evaluation result of the board book image data, to obtain a visual result, and includes:
and carrying out visual display on the parameter values and the distribution ranges of the analysis results of the blackboard-writing image data according to the evaluation results to obtain visual results.
In the embodiment of the application, the fifth module is used for visually displaying the analysis result and the evaluation result of the blackboard writing image data, and the blackboard writing skill data in the blackboard writing image can be displayed in a visual mode and used for displaying blackboard writing skill parameters, prompts, suggestions and the like. Different skill index parameters corresponding to the blackboard writing in the blackboard writing image and comparison results of the different skill index parameters and the range can be checked, and a user can conveniently improve the blackboard writing design by combining parameter values in the analysis results. The visual form can be displayed on the system display interface in the forms of images, tables and the like.
Further as a preferred embodiment, the sixth module is configured to generate an blackboard writing design analysis report according to the visualization result, and includes:
analyzing and processing the visual result according to a preset output report period to obtain a period analysis result;
and carrying out design level characteristic parameter analysis processing according to the period analysis result to generate an blackboard writing design analysis report.
In the embodiment of the application, the sixth module is configured to output a board writing design analysis report, and it is conceivable that the board writing design analysis includes a group board writing design analysis report that can be a personal analysis report or can be obtained by comprehensively analyzing a plurality of analysis reports. The module presents various characteristic parameters of the board design in the board image and supports presentation of comparison results with different user individuals and groups and reading of modification suggestions. The embodiment of the application can also self-define the output report period, the period can be set as times, weeks, months, school hours, school years and the like, and a personal or a certain stage of blackboard writing design analysis report is generated in the system, so that a user can know the procedural change and development of teaching blackboard writing design skills in a teaching blackboard writing diagram and timely acquire targeted suggestions.
On the other hand, the embodiment of the application also provides a teaching blackboard writing analysis method based on image recognition, which comprises the following steps:
acquiring a teaching blackboard writing image;
screening the teaching blackboard-writing image to obtain a blackboard-writing image to be analyzed;
performing image recognition processing on the to-be-analyzed blackboard-writing image, and performing skill parameter calculation processing on the to-be-analyzed blackboard-writing image according to a recognition result to obtain a blackboard-writing image data analysis result, wherein the skill parameters comprise font standardization, writing regularity, layout equilibrium and color quantity;
comparing the analysis result of the blackboard-writing image data with preset parameters, and evaluating the blackboard-writing image to be analyzed according to the comparison analysis result to obtain an evaluation result;
performing visual display processing on the analysis result and the evaluation result of the blackboard-writing image data to obtain a visual result;
and generating an blackboard writing design analysis report according to the visual result.
In the embodiment of the application, the teaching blackboard writing analysis method based on image recognition can be applied to a teaching blackboard writing analysis system based on image recognition, and the analysis method in the embodiment of the application can be applied to a terminal, a server, software running in the terminal or the server and the like. The terminal may be, but is not limited to, a tablet computer, a notebook computer, a desktop computer, etc. The server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDNs, basic cloud computing services such as big data and artificial intelligent platforms. It can be understood that the content in the embodiment of the teaching blackboard-writing analysis system based on image recognition is applicable to the embodiment of the method, the method specifically realized by the embodiment of the method is the same as the realization function of the point teaching blackboard-writing analysis system, and the obtained beneficial effects are the same as those obtained by the embodiment of the teaching blackboard-writing analysis system.
The embodiment of the application also provides electronic equipment, which comprises a processor and a memory; the memory is used for storing programs; the processor executes the program to implement the method as described above.
The embodiment of the application also provides a computer readable storage medium storing a program, which is executed by a processor to implement the method as described above.
Embodiments of the present application also disclose a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The computer instructions may be read from a computer-readable storage medium by a processor of a computer device, the computer instructions being executed by the processor to cause the computer device to perform the method as previously described.
In summary, the embodiment of the application has the following advantages: according to the teaching blackboard writing analysis system based on image recognition, which is provided by the embodiment of the application, teaching blackboard writing images uploaded or intercepted by a user can be automatically recognized through the system, and the teaching blackboard writing images are stored in the cloud storage server and analyzed in time. And the accuracy, objectivity and intelligent diagnosis level of analysis can be improved by automatically identifying, analyzing and diagnosing four skill indexes including the typeface standardization, writing regularity, layout equilibrium and color number of the blackboard writing in the image. In general, the teaching blackboard writing analysis system based on image recognition can dynamically, timely, truly and objectively reflect teaching blackboard writing design skill level, and is beneficial to pertinently training and improving the blackboard writing skill.
In some alternative embodiments, the functions/acts noted in the block diagrams may occur out of the order noted in the operational illustrations. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved. Furthermore, the embodiments presented and described in the flowcharts of the present application are provided by way of example in order to provide a more thorough understanding of the technology. The disclosed methods are not limited to the operations and logic flows presented herein. Alternative embodiments are contemplated in which the order of various operations is changed, and in which sub-operations described as part of a larger operation are performed independently.
Furthermore, while the application is described in the context of functional modules, it should be appreciated that, unless otherwise indicated, one or more of the described functions and/or features may be integrated in a single physical device and/or software module or one or more functions and/or features may be implemented in separate physical devices or software modules. It will also be appreciated that a detailed discussion of the actual implementation of each module is not necessary to an understanding of the present application. Rather, the actual implementation of the various functional modules in the apparatus disclosed herein will be apparent to those skilled in the art from consideration of their attributes, functions and internal relationships. Accordingly, one of ordinary skill in the art can implement the application as set forth in the claims without undue experimentation. It is also to be understood that the specific concepts disclosed are merely illustrative and are not intended to be limiting upon the scope of the application, which is to be defined in the appended claims and their full scope of equivalents.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Logic and/or steps represented in the flowcharts or otherwise described herein, e.g., a ordered listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program is printed, as the program may be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
It is to be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the present application have been shown and described, it will be understood by those of ordinary skill in the art that: many changes, modifications, substitutions and variations may be made to the embodiments without departing from the spirit and principles of the application, the scope of which is defined by the claims and their equivalents.
While the preferred embodiment of the present application has been described in detail, the present application is not limited to the embodiments described above, and those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit of the present application, and these equivalent modifications or substitutions are included in the scope of the present application as defined in the appended claims.
Claims (10)
1. An image recognition-based teaching blackboard writing analysis system, the system comprising:
the first module is used for acquiring a teaching blackboard writing image;
the second module is used for screening the teaching blackboard-writing images to obtain the blackboard-writing images to be analyzed;
the third module is used for carrying out image recognition processing on the to-be-analyzed blackboard-writing image, carrying out skill parameter calculation processing on the to-be-analyzed blackboard-writing image according to a recognition result to obtain a blackboard-writing image data analysis result, wherein the skill parameters comprise font standardization, writing regularity, layout equilibrium and color quantity;
the fourth module is used for comparing the analysis result of the blackboard-writing image data with preset parameters, and evaluating the blackboard-writing image to be analyzed according to the comparison analysis result to obtain an evaluation result;
the fifth module is used for carrying out visual display processing on the analysis result and the evaluation result of the blackboard-writing image data to obtain a visual result;
and a sixth module for generating an blackboard writing design analysis report according to the visual result.
2. The system of claim 1, wherein the first module for acquiring an image of a teaching blackboard writing comprises:
acquiring a teaching blackboard writing image or a teaching video clip uploaded by a client;
and carrying out image interception processing on the teaching video clip to obtain a teaching blackboard writing image.
3. The system of claim 1, wherein the second module is configured to perform screening processing on the teaching board writing image to obtain a board writing image to be analyzed, and includes:
performing image classification processing on the teaching blackboard writing image to obtain a classification result;
performing definition analysis processing on the teaching blackboard-writing image according to the classification result to obtain a definition analysis result;
and screening the teaching blackboard-writing image according to the definition analysis result to obtain the blackboard-writing image to be analyzed.
4. The system according to claim 1, wherein the third module is configured to perform image recognition processing on the to-be-analyzed board image, and perform skill parameter calculation processing on the to-be-analyzed board image according to a recognition result, to obtain a board image data analysis result, and includes:
performing image recognition processing on the to-be-analyzed blackboard-writing image to obtain a recognition font;
performing similarity calculation processing on the identification fonts according to preset standard fonts, and performing font standardization analysis processing on the to-be-analyzed blackboard-writing image according to the calculated similarity to obtain a first analysis result;
performing font regularity analysis processing on the to-be-analyzed blackboard-writing image according to the coordinate parameters of the identified fonts to obtain a second analysis result;
performing image entropy calculation on the to-be-analyzed blackboard-writing image, and performing layout equilibrium analysis processing on the to-be-analyzed blackboard-writing image according to an image entropy calculation result to obtain a third analysis result;
performing color space value extraction processing on the identification fonts, and performing color quantity analysis processing on the blackboard-writing image to be analyzed according to the extracted color space values to obtain a fourth analysis result;
and determining the first analysis result, the second analysis result, the third analysis result and the fourth analysis result as board writing image data analysis results.
5. The system according to claim 1, wherein the fourth module is configured to perform a comparative analysis process on the analysis result of the board image data and a preset parameter, and perform an evaluation process on the board image to be analyzed according to the comparative analysis result, to obtain an evaluation result, and includes:
comparing the analysis result of the blackboard-writing image data with preset parameters to obtain a comparison analysis result;
and scoring the to-be-analyzed blackboard-writing image according to the comparison analysis result, and giving out improvement suggestions according to the scoring result to obtain an evaluation result.
6. The system of claim 1, wherein the fifth module is configured to perform a visual display process on the analysis result and the evaluation result of the board image data, to obtain a visual result, and includes:
and carrying out visual display on the parameter values and the distribution ranges of the analysis results of the blackboard-writing image data according to the evaluation results to obtain visual results.
7. The system of claim 1, wherein the sixth module for generating an blackboard writing design analysis report from the visualization result comprises:
analyzing and processing the visual result according to a preset output report period to obtain a period analysis result;
and carrying out design level characteristic parameter analysis processing according to the period analysis result to generate an blackboard writing design analysis report.
8. An image recognition-based teaching blackboard writing analysis method is characterized by comprising the following steps:
acquiring a teaching blackboard writing image;
screening the teaching blackboard-writing image to obtain a blackboard-writing image to be analyzed;
performing image recognition processing on the to-be-analyzed blackboard-writing image, and performing skill parameter calculation processing on the to-be-analyzed blackboard-writing image according to a recognition result to obtain a blackboard-writing image data analysis result, wherein the skill parameters comprise font standardization, writing regularity, layout equilibrium and color quantity;
comparing the analysis result of the blackboard-writing image data with preset parameters, and evaluating the blackboard-writing image to be analyzed according to the comparison analysis result to obtain an evaluation result;
performing visual display processing on the analysis result and the evaluation result of the blackboard-writing image data to obtain a visual result;
and generating an blackboard writing design analysis report according to the visual result.
9. An electronic device comprising a memory and a processor;
the memory is used for storing programs;
the processor executing the program implements the method of claim 8.
10. A computer readable storage medium storing a computer program, characterized in that the computer program, when executed by a processor, implements the method as claimed in claim 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310511676.6A CN116798047A (en) | 2023-05-08 | 2023-05-08 | Teaching blackboard writing analysis method and system based on image recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310511676.6A CN116798047A (en) | 2023-05-08 | 2023-05-08 | Teaching blackboard writing analysis method and system based on image recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116798047A true CN116798047A (en) | 2023-09-22 |
Family
ID=88038182
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310511676.6A Pending CN116798047A (en) | 2023-05-08 | 2023-05-08 | Teaching blackboard writing analysis method and system based on image recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116798047A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107481227A (en) * | 2017-07-27 | 2017-12-15 | 广州视源电子科技股份有限公司 | Teaching blackboard writing image processing method and device, intelligent teaching equipment and storage medium |
| CN109118509A (en) * | 2018-08-16 | 2019-01-01 | 深圳市天英联合教育股份有限公司 | Processing method, device, equipment and the storage medium of writing on the blackboard image |
| CN110298343A (en) * | 2019-07-02 | 2019-10-01 | 哈尔滨理工大学 | A kind of hand-written blackboard writing on the blackboard recognition methods |
| CN110347993A (en) * | 2019-07-11 | 2019-10-18 | 深圳云智教育科技有限公司 | A kind of writing on the blackboard management method and device |
| CN111008969A (en) * | 2019-12-06 | 2020-04-14 | 浙江蓝鸽科技有限公司 | Blackboard writing extraction and intelligent recognition method and system |
| US10978077B1 (en) * | 2019-10-31 | 2021-04-13 | Wisdom Garden Hong Kong Limited | Knowledge point mark generation system and method thereof |
| CN113537801A (en) * | 2021-07-23 | 2021-10-22 | 重庆晋才富熙科技有限公司 | Blackboard writing processing method, blackboard writing processing device, terminal and storage medium |
| CN115460353A (en) * | 2022-11-11 | 2022-12-09 | 深圳市鹏创软件有限公司 | Teaching tracking camera equipment configuration method and device, electronic equipment and medium |
| CN116012860A (en) * | 2022-12-29 | 2023-04-25 | 华南师范大学 | Teacher blackboard writing design level diagnosis method and device based on image recognition |
-
2023
- 2023-05-08 CN CN202310511676.6A patent/CN116798047A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107481227A (en) * | 2017-07-27 | 2017-12-15 | 广州视源电子科技股份有限公司 | Teaching blackboard writing image processing method and device, intelligent teaching equipment and storage medium |
| CN109118509A (en) * | 2018-08-16 | 2019-01-01 | 深圳市天英联合教育股份有限公司 | Processing method, device, equipment and the storage medium of writing on the blackboard image |
| CN110298343A (en) * | 2019-07-02 | 2019-10-01 | 哈尔滨理工大学 | A kind of hand-written blackboard writing on the blackboard recognition methods |
| CN110347993A (en) * | 2019-07-11 | 2019-10-18 | 深圳云智教育科技有限公司 | A kind of writing on the blackboard management method and device |
| US10978077B1 (en) * | 2019-10-31 | 2021-04-13 | Wisdom Garden Hong Kong Limited | Knowledge point mark generation system and method thereof |
| CN111008969A (en) * | 2019-12-06 | 2020-04-14 | 浙江蓝鸽科技有限公司 | Blackboard writing extraction and intelligent recognition method and system |
| CN113537801A (en) * | 2021-07-23 | 2021-10-22 | 重庆晋才富熙科技有限公司 | Blackboard writing processing method, blackboard writing processing device, terminal and storage medium |
| CN115460353A (en) * | 2022-11-11 | 2022-12-09 | 深圳市鹏创软件有限公司 | Teaching tracking camera equipment configuration method and device, electronic equipment and medium |
| CN116012860A (en) * | 2022-12-29 | 2023-04-25 | 华南师范大学 | Teacher blackboard writing design level diagnosis method and device based on image recognition |
Non-Patent Citations (1)
| Title |
|---|
| 刘夕冉;马秋石;陈育;陈帅文;彭长德;: "课堂板书定量评价指标体系的构建", 科技资讯, no. 17, 13 June 2018 (2018-06-13) * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Mantiuk et al. | Comparison of four subjective methods for image quality assessment | |
| US7778489B1 (en) | Method and system for determining the legibility of text in an image | |
| WO2021139258A1 (en) | Image recognition based cell recognition and counting method and apparatus, and computer device | |
| EP2741254A1 (en) | Color determination device, color determination system, color determination method, information recording medium, and program | |
| CN108764352B (en) | Method and device for detecting repeated page content | |
| CN111143613A (en) | Method, system, electronic device and storage medium for selecting video cover | |
| CN110909035A (en) | Personalized review question set generation method and device, electronic equipment and storage medium | |
| US20190272769A1 (en) | Information processing device, information processing method, and non-transitory computer readable medium storing information processing program | |
| CN107193467B (en) | Method and equipment for displaying intelligent pen writing content | |
| WO2017016886A1 (en) | System and method for providing a recipe | |
| CN111597305B (en) | Entity marking method, entity marking device, computer equipment and storage medium | |
| CN112819015A (en) | Image quality evaluation method based on feature fusion | |
| CN110990617B (en) | Picture marking method, device, equipment and storage medium | |
| CN111325705A (en) | Image processing method, device, equipment and storage medium | |
| CN116012860B (en) | Teacher blackboard writing design level diagnosis method and device based on image recognition | |
| CN111914850B (en) | Picture feature extraction method, device, server and medium | |
| CN116798047A (en) | Teaching blackboard writing analysis method and system based on image recognition | |
| CN116612478A (en) | Off-line handwritten Chinese character scoring method, device and storage medium | |
| US20220207724A1 (en) | Method of determining a distribution of stem cells in a cell image, electronic device, and storage medium | |
| CN111083468B (en) | Short video quality evaluation method and system based on image gradient | |
| CN114550918A (en) | Mental disorder evaluation method and system based on drawing characteristic data | |
| CN113592765A (en) | Image processing method, device, equipment and storage medium | |
| Mittal et al. | Automatic prediction of saliency on JPEG distorted images | |
| Quadri | Constructing Frameworks for Task-Optimized Visualizations | |
| CN114138214B (en) | Method and device for automatically generating print file and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |