CN114998911A

CN114998911A - Data entry method and device and electronic equipment

Info

Publication number: CN114998911A
Application number: CN202210740762.XA
Authority: CN
Inventors: 李泽; 王俊; 蔡益平
Original assignee: Hangzhou Hailiang Youzhi Technology Co ltd
Current assignee: Hangzhou Hailiang Youzhi Technology Co ltd
Priority date: 2022-06-28
Filing date: 2022-06-28
Publication date: 2022-09-02

Abstract

The embodiment of the invention provides a data entry method, a data entry device and electronic equipment, and relates to the technical field of image processing. The method comprises the following steps: acquiring an image to be recorded; performing Optical Character Recognition (OCR) processing on the image to be recorded to obtain a recognition result of the image to be recorded; converting the specified data in the identification result, which belong to the specified format, into the subimage to be replaced; replacing the designated data by using the designated placeholder associated with the subimage to be replaced to obtain a target result; and inputting the target data indicated by the user in the target result into a preset entry area. Compared with the prior art, the scheme provided by the embodiment of the invention can improve the working efficiency of data entry when the paper data is entered into the online database.

Description

Data entry method and device and electronic equipment

Technical Field

The present invention relates to the field of image processing technologies, and in particular, to a data entry method and apparatus, and an electronic device.

Background

Currently, with the rapid development of science and technology, the recording and storing of paper data into an online database becomes one of the important ways to retain paper data. Such as documents, newspapers, famous literature, test papers, etc.

Because there may be text contents in complex forms such as various formulas, characters, etc., in paper materials, in order to ensure the accuracy of inputting paper materials into an online database, the paper materials are usually completed by manual input. However, the manual entry is slow and takes a lot of time.

Therefore, how to improve the data entry rate under the condition of ensuring the accuracy rate of the data entry becomes a problem which needs to be solved urgently at present.

Disclosure of Invention

The embodiment of the invention aims to provide a data entry method, a data entry device and electronic equipment, so that the data entry speed is increased under the condition that the accuracy rate of the data entry is ensured. The specific technical scheme is as follows:

in a first aspect, an embodiment of the present invention provides a data entry method, which is applied to an electronic device, and the method includes:

acquiring an image to be recorded;

performing Optical Character Recognition (OCR) processing on the image to be input to obtain a recognition result of the image to be input;

converting the specified data in the identification result, which belong to the specified format, into the subimage to be replaced;

replacing the designated data by using the designated placeholder associated with the subimage to be replaced to obtain a target result;

and inputting the target data indicated by the user in the target result into a preset entry area.

Optionally, in a specific implementation manner, the converting the specified data in the specified format in the recognition result into the sub-image to be replaced includes:

carrying out format conversion on the specified data belonging to the specified format in the identification result to obtain transition data belonging to a preset format; and carrying out image conversion on the transition data to obtain a sub-image to be replaced.

Optionally, in a specific implementation manner, the inputting target data indicated by the user in the target result into a preset entry area includes:

when a data selection operation sent by a user is detected, determining target data indicated in the target result by the data selection operation;

and when the data entry operation sent by the user is detected, inputting the target data into a preset entry area.

Optionally, in a specific implementation manner, the recognition result includes: each data in the image to be recorded and the position information of each data;

before the inputting the target data indicated in the target result by the user into the preset entry area, the method further includes:

marking each data in the target result with a specified type based on the position information of each data;

when detecting a data selection operation sent by a user, determining target data indicated in the target result by the data selection operation includes:

and when detecting that the user performs specified operation on each target mark in the target result, determining the data marked by the target mark as target data.

Optionally, in a specific implementation manner, before performing optical character recognition OCR processing on the image to be input to obtain a recognition result of the image to be input, the method further includes:

judging whether the image to be recorded has specified data in the specified format or not;

the OCR processing is carried out on the image to be recorded to obtain the recognition result of the image to be recorded, and the OCR processing comprises the following steps:

and if the image to be recorded has the specified data in the specified format, identifying the image to be recorded by adopting an OCR with the specified format identification function to obtain an identification result of the image to be recorded.

Optionally, in a specific implementation manner, the method further includes:

and storing the data in the entry area into a designated storage space.

Optionally, in a specific implementation manner, the method further includes:

modifying the data in the entry area based on a modification instruction sent by a user.

Optionally, in a specific implementation manner, the method is applied to a browser in the electronic device; and the image format of the sub-image to be replaced is the image format supported by the browser.

In a second aspect, an embodiment of the present invention provides a data entry device, which is applied to an electronic device, and the device includes:

the image acquisition module is used for acquiring an image to be recorded;

the image recognition module is used for carrying out Optical Character Recognition (OCR) processing on the image to be recorded to obtain a recognition result of the image to be recorded;

the image conversion module is used for converting the specified data in the specified format in the identification result into the subimage to be replaced;

the result acquisition module is used for replacing the specified data by using the specified placeholder associated with the subimage to be replaced to obtain a target result;

and the data entry module is used for inputting the target data indicated by the user in the target result into a preset entry area.

Optionally, in a specific implementation manner, the image conversion module is specifically configured to:

Optionally, in a specific implementation manner, the data entry module includes:

the selection submodule is used for determining target data indicated by the data selection operation in the target result when the data selection operation sent by a user is detected;

and the entry sub-module is used for inputting the target data into a preset entry area when the data entry operation sent by the user is detected.

Optionally, in a specific implementation manner, the recognition result includes: each data in the image to be recorded and the position information of each data; the apparatus further comprises a marking module:

the marking module is used for marking each data in the target result in a designated type based on the position information of each data before inputting the target data indicated by the user in the target result into a preset input area;

the selection submodule is specifically configured to: and when detecting that the user performs specified operation on each target mark in the target result, determining the data marked by the target mark as target data.

Optionally, in a specific implementation manner, the apparatus further includes a determining module:

the judging module is used for judging whether the image to be recorded has the specified data in the specified format or not before performing Optical Character Recognition (OCR) processing on the image to be recorded to obtain a recognition result of the image to be recorded;

the image recognition module is specifically configured to: and if the image to be recorded has the specified data in the specified format, identifying the image to be recorded by adopting an OCR with the specified format identification function to obtain an identification result of the image to be recorded.

Optionally, in a specific implementation manner, the apparatus further includes a storage module:

the storage module is used for storing the data in the entry area into a designated storage space.

Optionally, in a specific implementation manner, the apparatus further includes a modification module:

and the modification module is used for modifying the data in the entry area based on a modification instruction sent by a user.

Optionally, in a specific implementation manner, the apparatus is applied to a browser in the electronic device; and the image format of the sub-image to be replaced is the image format supported by the browser.

In a third aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor and the communication interface complete communication between the memory and the processor through the communication bus;

a memory for storing a computer program;

a processor, configured to implement the steps of any of the data entry methods provided by the first aspect when executing a program stored in the memory.

In a fourth aspect, the present invention provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of any one of the data entry methods provided in the first aspect.

In a fifth aspect, embodiments of the present invention provide a computer program product containing instructions which, when run on a computer, cause the computer to perform the steps of any of the data entry methods described above in the first aspect.

The embodiment of the invention has the following beneficial effects:

as can be seen from the above, by applying the scheme provided by the embodiment of the present invention, the data entry method is applied to the electronic device. When data entry is carried out on an image to be entered, firstly, the image to be entered is obtained, and then, optical character recognition OCR processing is carried out on the image to be entered, so that a recognition result of the image to be entered can be obtained. Therefore, the specified data in the identification result, which belongs to the specified format, can be converted into the subimage to be replaced, and then the specified data is replaced by the specified placeholder associated with the subimage to be replaced, so that a target result is obtained, and further, the target data indicated by the user in the target result can be input into a preset input area.

Based on this, by applying the scheme provided by the embodiment of the present invention, for the specified data belonging to the specified format, the specified data can be replaced by the sub-image to be replaced of the specified data. That is to say, for the specified data such as a formula and a character in a specified format, the specified data can be subjected to image recognition to obtain a to-be-replaced sub-image of the specified data, and the specified data is replaced by the to-be-replaced sub-image, so that the situations of data messy codes, errors and the like in the data entry process can be avoided, and the accuracy of data entry is improved. In addition, the user can select the data to be input from the target result based on the self requirement as the target data, and further, the data input rate is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by referring to these drawings.

Fig. 1 is a schematic flow chart of a first data entry method according to an embodiment of the present invention;

fig. 2 is a schematic flow chart of a second data entry method according to an embodiment of the present invention;

fig. 3 is a schematic flow chart of a third data entry method according to an embodiment of the present invention;

fig. 4 is a schematic flow chart of a fourth data entry method according to an embodiment of the present invention;

FIG. 5 is a diagrammatic representation of a designated area provided by the present invention;

FIG. 6 is a diagram of one embodiment of the present invention;

FIG. 7(a) is a schematic flow chart of an embodiment of the present invention;

FIG. 7(b) is a schematic view of a detailed flow chart of step three, step four and step five in FIG. 7 (a);

fig. 8 is a schematic flowchart of a fifth data entry method according to an embodiment of the present invention;

fig. 9 is a schematic flowchart of a sixth data entry method according to the embodiment of the present invention;

fig. 10 is a schematic structural diagram of a data entry device according to an embodiment of the present invention;

fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived from the embodiments given herein by one of ordinary skill in the art, are within the scope of the invention.

Currently, with the rapid development of science and technology, the recording and storing of paper data into an online database becomes one of the important ways to retain paper data. Such as documents, newspapers, famous literature, test papers, etc. Because there may be text contents in complex forms such as various formulas, characters, etc., in paper materials, in order to ensure the accuracy of inputting paper materials into an online database, the paper materials are usually completed by manual input. However, the manual entry is slow and takes a lot of time. Therefore, how to improve the data entry rate under the condition of ensuring the accuracy rate of the data entry becomes a problem which needs to be solved urgently at present.

In order to solve the above technical problem, an embodiment of the present invention provides a data entry method.

The method is suitable for various application scenes in which paper data are required to be input into an online database, for example, test questions of test papers are input into the online database. For another example, the history document is entered into a database or the like related to the history document. The method can be applied to various electronic devices such as notebook computers, tablet computers and desktop computers, and is hereinafter referred to as electronic devices for short. Based on this, the embodiment of the present invention does not limit the application scenario and the execution subject of the method.

The method can be applied to a browser of the electronic equipment, can also be applied to a specified application program installed in the electronic equipment, and can also be applied to special electronic equipment for data entry. The embodiment of the present invention is not particularly limited.

The data entry method provided by the embodiment of the invention can comprise the following steps:

acquiring an image to be recorded;

A data entry method provided in an embodiment of the present invention is specifically described below with reference to the accompanying drawings.

Fig. 1 is a schematic flow chart of a data entry method according to an embodiment of the present invention, as shown in fig. 1, the method includes the following steps S101 to S105:

s101: and acquiring an image to be recorded.

In the process of data entry included in various application scenarios, for example, documents, newspapers, famous works, test questions of test papers, and the like, the electronic device may first acquire an image to be entered.

For example, the electronic device has an image acquisition function, and can directly shoot paper data to be input, so that an image to be input is acquired. For another example, the electronic device may obtain an image to be recorded obtained by acquiring an image of paper data to be recorded by other electronic devices. The embodiment of the present invention is not particularly limited.

S102: and performing Optical Character Recognition (OCR) processing on the image to be recorded to obtain a recognition result of the image to be recorded.

After the image to be recorded is obtained, performing Optical Character Recognition (OCR) processing on the image to be recorded to obtain a recognition result of the image to be recorded.

The Optical Character Recognition (OCR) refers to a process of scanning text data, analyzing an image file, and acquiring text and layout information.

Optionally, the recognition result may include data content and location information of each line in the image to be recorded.

In some cases, a formula, a character and the like which are easy to identify errors may exist in an image to be entered, so that when the image to be entered is subjected to OCR recognition, whether the OCR with a specified format recognition function is adopted to recognize the image to be entered can be determined according to whether the formula, the character and the like exist in the image to be entered, thereby avoiding the situations of messy codes, errors and the like caused by recognition of the image to be entered by the OCR, modifying the messy codes, the errors and the like through manual operation, reducing the efficiency of data entry, and increasing the labor cost.

Optionally, in a specific implementation manner, as shown in fig. 2, the data entry method provided in the embodiment of the present invention may further include the following step S106:

s106: judging whether the image to be recorded has specified data in a specified format or not;

accordingly, the step S102 may include the following step S1021:

s1021: if the image to be recorded has the designated data in the designated format, identifying the image to be recorded by adopting the OCR with the designated format identification function to obtain an identification result of the image to be recorded.

In this specific implementation manner, after the image to be recorded is obtained, it may be determined whether the image to be recorded has specified data in a specified format.

Optionally, a designated label is added to the image to be recorded with the designated data in the designated format, so that after the image to be recorded is acquired, label recognition can be performed on the image to be recorded, and when the designated label is recognized, the image to be recorded is recognized by using an OCR having a designated format recognition function.

For example, before data entry is performed on test questions of test papers such as mathematics, physics, chemistry, and the like, a designated label is added to an image to be entered for the subject, so that after an image to be entered for a test paper for each subject is acquired, label recognition can be performed on the image to be entered, and when the designated label is recognized, the image to be entered is recognized by using OCR having a designated format recognition function.

And if the image to be recorded has the specified data in the specified format, identifying the image to be recorded by adopting an OCR (optical character recognition) with a specified format identification function, thereby obtaining an identification result of the image to be recorded.

Therefore, the situations of messy codes, errors and the like in the obtained recognition result when the OCR is used for recognizing the image to be recorded due to the fact that the OCR does not have the specified format recognition function can be avoided, the data recording efficiency is improved, and the labor cost is reduced.

S103: and converting the specified data in the identification result, which belong to the specified format, into the sub-image to be replaced.

After the recognition result of the image to be recorded is obtained, the specified data belonging to the specified format in the recognition result can be determined, and the specified data is converted into the sub-image to be replaced.

For example, the designation data of the above-described designation format may be designation data containing characters of the formula LATEX (Latah Hertz). The embodiment of the present invention is not particularly limited. LATEX is a typesetting system developed by LeslieLamport of computer students in America, and is suitable for large-scale paper typesetting and mathematical formula input.

Optionally, the embodiment of the present invention may be applied to a browser in an electronic device, and therefore, the image format of the sub-image to be replaced is an image format supported by the browser in the electronic device.

For example, an Image Format supported by a browser in the electronic device is a TIFF (Tagged Image File Format) Format. If the sub-image to be replaced is in a JPEG (Joint Photographic Experts Group) format, the browser does not support viewing the sub-image to be replaced.

Among them, the so-called TIFF format is a file format mainly used for storing images including photographs and art drawings. The so-called JPEG format is an image document for displaying pictures and other continuous tones, and is the most commonly used image file format.

Optionally, in a specific implementation manner, as shown in fig. 3, the step S103 may include the following step S1031:

s1031: carrying out format conversion on the specified data belonging to the specified format in the identification result to obtain transition data belonging to a preset format; and performing image conversion on the transition data to obtain a sub-image to be replaced.

In this specific implementation manner, after the recognition result of the image to be recorded is obtained, format conversion may be performed on the specified data belonging to the specified format in the recognition result, so that transition data belonging to a preset format may be obtained, and further, image conversion may be performed on the transition data to obtain a sub-image to be replaced of the specified data.

For example, if the preset format is MATHML (mathematic Markup Language) characters, the data belonging to the recognition result and containing the LATEX characters can be converted into the MATHML characters, and the formula pictures are called to perform image conversion on the MATHML characters, so as to obtain sub-images to be replaced in the SVG (Scalable Vector Graphics) format.

S104: and replacing the specified data by using the specified placeholder associated with the subimage to be replaced to obtain a target result.

After the to-be-replaced sub-image of the designated data is obtained, the association relation between the designated placeholder and the to-be-replaced sub-image of the designated data can be established.

In this way, after the to-be-replaced sub-image of the designated data is obtained according to the transition data, the designated data can be replaced by the designated placeholder associated with the to-be-replaced sub-image based on the established association relationship between the designated placeholder and the to-be-replaced sub-image of the designated data, and thus, the target result of the to-be-recorded image can be obtained.

That is, the sub-image to be replaced of the specified data is linked to the page where the recognition result after OCR recognition is located through the associated specified placeholder.

For example, when the data entry method provided by the embodiment of the present invention is executed by using a browser, a sub-image to be replaced of the specified data may be linked into an HTML (hypertext Markup Language) page by specifying a placeholder < img > tag.

Illustratively, as shown in table 1, a specified table characterizing the association relationship between the specified data in the specified format, the transition data in the preset format, the sub-image to be replaced and the specified placeholder is shown.

As shown in table 1, is a partial table of the above-specified table.

TABLE 1

Specified data of specified format	Transitional data in preset format	Sub-images to be replaced	Specifying placeholders
				A	a	T _A	Z _A
B	b	T _B	Z _B
				C	c	T _C	Z _C

After the designated data a is subjected to format conversion to obtain transition data a in a preset format, image conversion can be performed on the transition data a to obtain a to-be-replaced sub-image T of the designated data a _A Thus, a reference to specifying placeholder Z can be established _A With the sub-image T to be replaced of the specified data A _A By associating the subimages T to be replaced _A Is assigned a placeholder Z _A Replacing the specified data A; after the format conversion is carried out on the specified data B to obtain transition data B with a preset format, the transition data B can be subjected to image conversion to obtain a to-be-replaced sub-image T of the specified data B _B Thus, a reference to specifying placeholder Z can be established _B With the sub-picture T to be replaced of the specified data B _B By associating the subimages T to be replaced _B Is assigned a placeholder Z _B Replacing the specified data B; after the designated data C is subjected to format conversion to obtain transition data C in a preset format, the transition data C can be subjected to image conversion to obtain a to-be-replaced sub-image T of the designated data C _C Thus, a reference to specifying placeholder Z can be established _C With the sub-image T to be replaced of the specified data C _C By associating the subimages T to be replaced _C Is assigned a placeholder Z _C Replacing the above-mentioned specified data C.

Thus, after the sub-image to be replaced is obtained, the designated placeholder associated with the sub-image to be replaced can be determined by using the table 1, and thus the designated data is replaced by the designated placeholder, and a target result is obtained.

S105: and inputting the target data indicated by the user in the target result into a preset entry area.

And after the target result of the image to be input is obtained, outputting the target result to a user. After receiving the target result, the user can select target data from the target result. Therefore, after the target data indicated in the target result by the user is received, the target data indicated in the target result is input to a preset input area.

Optionally, the user may select all the contents in the image to be entered for data entry.

Optionally, the user may select a part of the content in the image to be entered for data entry.

Therefore, the steps S101 to S105 can be avoided from being executed for a plurality of times when data is recorded for partial contents in the same image to be recorded, and the speed of data recording is further improved.

Optionally, in a specific implementation manner, as shown in fig. 4, the step S105 may include the following steps S1051 to S1052:

s1051: when detecting a data selection operation sent by a user, determining target data indicated by the data selection operation in a target result;

s1052: when detecting a data entry operation sent by a user, inputting target data into a preset entry area.

In this specific implementation manner, after the target result of the image to be input is obtained, the target result may be sent to the user. And when detecting a data selection operation sent by a user, determining target data indicated by the data selection operation in the target result, and when detecting a data entry operation sent by the user, inputting the target data into a preset entry area.

Optionally, in a specific implementation manner, the recognition result includes: each data to be input into the image and the position information of each data; before inputting the target data indicated by the user in the target result into the preset entry area in the above step S105, the following steps 11 may be included:

step 11: marking each data in the target result with a specified type based on the position information of each data;

accordingly, the step S105 may include the following step 1051:

step 1051: and when detecting that the user performs a specified operation on each target mark in the target result, determining the data marked by the target mark as target data.

In this specific implementation, after the target result of the image to be entered is obtained, the data in the target result may be marked with a designated type based on the position information of the data in the image to be entered in the recognition result of the image to be entered, so that when it is detected that the user performs a designation operation on the data in the target result, the data marked by the target mark is determined as the target data.

Optionally, the data selecting operation may include a pointing operation and a framing operation for designating a region.

Illustratively, as shown in fig. 5, a diagram of a designated area is provided for the present invention. In fig. 5, 500 is a designated area 500, and each data in the designated area 500 is target data; each 501 in fig. 5 is each data to which a marker of a specified type is added in the target result, and thus each data to which a marker of a specified type is added can be directly clicked as each target data based on a clicking operation by a user.

In this way, after the target data is determined, the target data can be input to a preset input area when a data input operation sent by a user is detected.

Optionally, the data entry operation may include a copy and paste operation. When the copy and paste operation sent by the user is detected, the target data is copied and then pasted in a preset recording area.

Optionally, when the target data is input into the preset entry area, the target data may be sorted according to a designated sequence, and a new serial number is automatically calibrated for the target data, so that a large amount of manual intervention may be avoided, and further, the speed of data entry is improved.

Illustratively, as shown in fig. 6, a diagram of one embodiment of the present invention is provided. In fig. 5, after detecting a frame selection designation region operation sent by a user, question options in a designation region 500 indicated by the frame selection designation region operation may be used as target data for the test questions of the test paper. After detecting the copy and paste operation sent by the user, the title option in the designated area 500 can be copied and pasted into the preset entry area 600. In the entry area 600, the question options are sorted according to a designated sequence, and a new serial number is automatically marked for the question options.

For easy understanding, fig. 7(a) is a schematic flow chart of an embodiment of the present invention.

Wherein, step one of fig. 7 (a): clicking and uploading a picture of a test paper on a page, and the second step: the picture is successfully uploaded and is displayed at the position of the picture displayed on the left side of the page, namely the picture to be recorded is obtained in the embodiment of the invention;

step three in fig. 7 (a): calling the content in the OCR recognition picture, and acquiring each row of content and corresponding coordinate information, namely performing Optical Character Recognition (OCR) processing on the image to be input in the embodiment of the invention to obtain a recognition result of the image to be input, wherein the recognition result comprises the following steps: each data to be recorded in the image and the position information of each data;

step four in fig. 7 (a): analyzing the content data of each line, and performing formula picture conversion which can be identified by a browser on the related formula content, namely performing format conversion on the specified data which belongs to the specified format in the identification result to obtain transition data which belongs to a preset format; performing image conversion on the transition data to obtain a to-be-replaced sub-image in an image format supported by the browser;

step five in fig. 7 (a): performing relevant data packaging response on the identified analysis result to the browser, namely replacing the designated data in the identification result by the subimage to be replaced to obtain a target result;

step six in fig. 7 (a): obtaining the specific position of each line of content according to the data coordinate information provided by the browser, and using a red line to circle out each line of content, wherein the red line is the position information based on each data in the embodiment of the invention, and each data in the target result is marked with the specified type;

step seven in fig. 7 (a): a user circles a selected range by moving a mouse, and locks a target row, namely, when detecting that the user performs specified operation on each target mark in a target result, determining data marked by the target mark as target data;

step eight in fig. 7 (a): the user can input ctrl + c/command + c, the browser copies the target row contents, and step nine: the user clicks the text box area of the editor, and content pasting can be performed by inputting ctrl + v/command + v, that is, when the copy and paste operation sent by the user is detected, the target data is copied and pasted to the preset input area according to the embodiment of the present invention.

And clicking a picture uploading button on a page of the browser by a user to upload a picture of a test paper. When the picture is uploaded successfully, the picture is displayed at the position of the display picture on the left side of the page. Then, OCR can be called to carry out content recognition on the picture, so that each line of content and corresponding coordinate information in the picture are obtained, further, data analysis can be carried out on each line of content, related formula content is converted into a formula picture which can be recognized by a browser, and then, related data packaging can be carried out on recognition analysis results and the recognition results are responded to the browser.

Therefore, the specific position of each line of content can be determined according to the data coordinate information provided by the browser, and each line of content is circled by a red line. The user can circle the selected range by operating the mouse, so that the target row needing data entry is locked, the user can copy the content of the target row by inputting ctrl + c/command + c and paste the content by inputting ctrl + v/command + v, and the data entry of the target row in the picture is completed.

Illustratively, as shown in fig. 7(b), a detailed flow diagram of step three, step four and step five in fig. 7(a) is shown.

In fig. 7(b), the judgment and identification mode is the judgment of whether the image to be recorded has the specified data in the specified format according to the subject in the embodiment of the present invention;

the query OCR in fig. 7(b) returns a character array, finds out that formula character content (in a leax format) is specified data in a specified format in the image to be recorded according to the embodiment of the present invention, and identifies the image to be recorded by using an OCR having a specified format identification function to obtain an identification result of the image to be recorded;

the formula character content in fig. 7(b) is replaced by the designated placeholder, which is the designated placeholder replacement designation data of the embodiment of the present invention;

formula format conversion in fig. 7 (b): letax → MATHML is that the embodiment of the invention carries on the format conversion to the appointed data belonging to the appointed format in the recognition result, get the transition data belonging to the preset format;

the record-converted MATHML formula list in fig. 7(b), and the record positions of the Letax formula list and the corresponding positions of the MATHML formula list are the specified tables that record the association relationship between the specified data for representing the specified format, the transition data in the preset format, the sub-image to be replaced, and the specified placeholder in the embodiment of the present invention;

the invoking formula conversion service in fig. 7(b) batch converts the MATHML formula into img (image) tags, which is an embodiment of the present invention that replaces the specified data with the specified placeholders associated with the subimages to be replaced;

replacing the designated placeholder with the formula img tag according to the position information in fig. 7(b) is to replace the designated data in the recognition result with the designated placeholder associated with the sub-image to be replaced according to the embodiment of the present invention; in the step (b) of fig. 7, character concatenation is performed, and the returned result is the target result obtained in the embodiment of the present invention.

And (3) selecting an adaptive recognition mode by a user according to the subject, querying an OCR (optical character recognition) returned character array if a formula does not exist in the picture, splicing the characters, and returning a result. If the formula exists in the picture, the OCR return character array can be inquired, the character content (Letax format) of the formula is found out, the character content of the formula is replaced by the appointed placeholder, and then the format of the character content of the formula can be converted from the Letax format to the MATHML format through the conversion of the formula format.

Recording the converted MATHML formula list, calling formula conversion service based on the recorded Letax formula list position and the corresponding MATHML formula list position, and converting the MATHML formula into img labels in batches, so that the designated placeholder can be replaced by the formula img labels according to the position information, the replacement of characters with a Letax format corresponding to the formula character content by the formula img labels is realized, and finally, all the characters are spliced, and a result is returned.

As can be seen from the above, by applying the scheme provided by the embodiment of the present invention, the data entry method is applied to the electronic device. When data entry is carried out on an image to be entered, firstly, the image to be entered is obtained, then, Optical Character Recognition (OCR) processing is carried out on the image to be entered, and therefore a recognition result of the image to be entered can be obtained. Therefore, the specified data in the identification result, which belongs to the specified format, can be converted into the subimage to be replaced, and then the specified data is replaced by the specified placeholder associated with the subimage to be replaced, so that a target result is obtained, and further, the target data indicated by the user in the target result can be input into a preset input area.

Based on this, by applying the scheme provided by the embodiment of the present invention, for the specified data belonging to the specified format, the specified data can be replaced by the sub-image to be replaced of the specified data. That is to say, for the specified data such as a formula and a character in a specified format, the specified data can be subjected to image recognition to obtain a to-be-replaced sub-image of the specified data, and the specified data is replaced by the to-be-replaced sub-image, so that the conditions of data messy codes, errors and the like in the data entry process can be avoided, and the accuracy of data entry is improved. In addition, the user can select the data to be input from the target result based on the self requirement as the target data, and further, the data input rate is improved.

In some cases, the data of the data entry can be stored in the designated storage space, so that when the data entry is used later, the data entry can be directly extracted from the designated storage space, and repeated data entry aiming at the same data is avoided.

Optionally, in a specific implementation manner, as shown in fig. 8, the data entry method provided in the embodiment of the present invention further includes the following step S801:

s801: and storing the data in the entry area into a designated storage space.

In this specific implementation manner, after the target data is input to the preset entry area, the data in the entry area may be stored in the designated storage space.

Optionally, after the data is input into the entry area, the data in the entry area may be stored in a designated storage space.

Optionally, for an image to be entered, after all the selected target data in the image to be entered are input to the entry area, all the data in the entry area may be stored in the designated storage space.

Alternatively, a given storage space stores one type of data.

In some cases, after the target data is input to a preset entry area, errors may exist in the data in the entry area, and therefore, in order to improve the accuracy of data entry, if an error exists in the data in the entry area, the data in which the error exists may be modified.

Based on this, optionally, in a specific implementation manner, as shown in fig. 9, the method for data entry provided in the embodiment of the present invention may further include the following step S901:

s901: modifying the data in the entry area based on the modification instruction sent by the user.

In this specific implementation manner, after the target data is input to the preset entry area, if there is an error in the data in the entry area, the data with the error in the entry area may be modified based on a modification instruction sent by the user, so that the accuracy of data entry is improved.

Optionally, the data entry method provided by the embodiment of the present invention is applied to a browser in an electronic device; the image format of the sub-image to be replaced is the image format supported by the browser.

Corresponding to the data entry method provided by the embodiment of the invention, the embodiment of the invention also provides a data entry device.

Fig. 10 is a schematic structural diagram of a data entry device according to an embodiment of the present invention, and as shown in fig. 10, the device may include the following modules:

the image acquisition module 1010 is used for acquiring an image to be recorded;

the image recognition module 1020 is configured to perform Optical Character Recognition (OCR) processing on the image to be input to obtain a recognition result of the image to be input;

the image conversion module 1030 is configured to convert the specified data in the specified format in the recognition result into a sub-image to be replaced;

the result obtaining module 1040 is configured to replace the specified data with a specified placeholder associated with the sub-image to be replaced, so as to obtain a target result;

and a data entry module 1050, configured to input target data indicated in the target result by the user into a preset entry area.

Optionally, in a specific implementation manner, the image conversion module 1030 is specifically configured to:

Optionally, in a specific implementation manner, the data entry module 1050 includes:

the image recognition module 1020 is specifically configured to: and if the image to be recorded has the specified data in the specified format, identifying the image to be recorded by adopting an OCR with the specified format identification function to obtain an identification result of the image to be recorded.

Corresponding to the data entry method provided by the above embodiment of the present invention, an embodiment of the present invention further provides an electronic device, as shown in fig. 11, including a processor 1101, a communication interface 1102, a memory 1103 and a communication bus 1104, where the processor 1101, the communication interface 1102 and the memory 1103 complete communication with each other through the communication bus 1104,

a memory 1103 for storing a computer program;

the processor 1101 is configured to implement the steps of any one of the data entry methods provided by the embodiments of the present invention described above when executing the program stored in the memory xx 3.

The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the electronic equipment and other equipment.

The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.

In a further embodiment provided by the present invention, there is also provided a computer readable storage medium having stored therein a computer program which, when executed by a processor, implements the steps of any of the data entry methods described above.

In a further embodiment provided by the present invention, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform any of the data entry methods of the embodiments described above.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, apparatus embodiments, electronic device embodiments, computer-readable storage medium embodiments, and computer program product embodiments are described for simplicity because they are substantially similar to method embodiments, as may be found in some descriptions of method embodiments.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims

1. A data entry method is applied to electronic equipment, and the method comprises the following steps:

acquiring an image to be recorded;

performing Optical Character Recognition (OCR) processing on the image to be recorded to obtain a recognition result of the image to be recorded;

converting the specified data belonging to the specified format in the identification result into a sub-image to be replaced;

replacing the designated data by using the designated placeholder associated with the sub-image to be replaced to obtain a target result;

2. The method according to claim 1, wherein converting the specified data in the specified format in the recognition result into the sub-image to be replaced comprises:

3. The method according to claim 1, wherein the inputting target data indicated in the target result by the user to a preset entry area comprises:

4. The method of claim 1, wherein the recognition result comprises: each data in the image to be recorded and the position information of each data;

before the inputting the target data indicated by the user in the target result into the preset entry area, the method further includes:

5. The method according to claim 1, wherein before performing Optical Character Recognition (OCR) processing on the image to be entered to obtain a recognition result of the image to be entered, the method further comprises:

6. The method of claim 1, further comprising:

and storing the data in the entry area into a designated storage space.

7. The method of claim 1, further comprising:

8. The method according to any one of claims 1-7, wherein the method is applied to a browser in the electronic device; and the image format of the sub-image to be replaced is the image format supported by the browser.

9. A data entry device, applied to an electronic device, the device comprising:

the image acquisition module is used for acquiring an image to be recorded;

10. The apparatus of claim 9, wherein the image conversion module is specifically configured to:

11. The apparatus of claim 9, wherein the image entry module comprises:

12. The apparatus of claim 9, wherein the recognition result comprises: each data and the position information of each data in the image to be recorded; the apparatus further comprises a marking module:

13. The apparatus of claim 9, further comprising a determining module:

14. The apparatus of claim 9, further comprising a storage module to:

15. The apparatus of claim 9, further comprising a modification module to:

16. The apparatus according to any one of claims 9-15, wherein the apparatus is applied to a browser in the electronic device; and the image format of the sub-image to be replaced is the image format supported by the browser.

17. The electronic equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing the communication between the processor and the memory through the communication bus;

a memory for storing a computer program;

a processor for implementing the method steps of any of claims 1 to 8 when executing a program stored in the memory.

18. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of the claims 1-8.