CN111753607A - Writing track detection method and electronic equipment - Google Patents

Abstract

The embodiment of the invention relates to the technical field of electronic equipment, and discloses a writing track detection method and electronic equipment, wherein the method comprises the following steps: acquiring a target RGB value corresponding to a pixel point of a text position in a written page image; respectively detecting a first region coordinate corresponding to an R channel, a second region coordinate corresponding to a G channel and a third region coordinate corresponding to a B channel in a target RGB value; comparing and synthesizing the first area coordinate, the second area coordinate and the third area coordinate to obtain a target area coordinate corresponding to a target RGB value; obtaining a writing track of the writing content according to the target area coordinates; the method can be used for improving the detection accuracy of the writing track and improving the recognition rate of the writing result.

Description

Writing track detection method and electronic equipment

Technical Field

The invention relates to the technical field of electronic equipment, in particular to a writing track detection method and electronic equipment.

Background

The process of implementing dictation assistance in a common electronic device generally includes: the method comprises the steps of obtaining dictation content, conducting voice reading, shooting an image of a paper writing page by using a camera of electronic equipment, conducting writing track recognition on the shot image, and judging whether the dictation content written on the paper writing page by a student is correct or not according to the writing track. However, when the electronic device performs image recognition, the electronic device often encounters interference information, such as redundant handwriting or transparent handwriting which is inadvertently scratched on a paper writing page by a student. For the interference information, the general image recognition technology adopted by the electronic equipment cannot effectively recognize the interference information, so that the detection accuracy of the writing track is influenced, and the final recognition result is influenced.

Disclosure of Invention

The embodiment of the invention discloses a writing track detection method and electronic equipment, which are used for improving the detection accuracy of a writing track.

The first aspect of the embodiments of the present invention discloses a writing track detection method, which may include:

acquiring a target RGB value corresponding to a pixel point of a text position in a written page image;

respectively detecting a first region coordinate corresponding to an R channel, a second region coordinate corresponding to a G channel and a third region coordinate corresponding to a B channel in the target RGB value;

comparing and synthesizing the first area coordinate, the second area coordinate and the third area coordinate to obtain a target area coordinate corresponding to the target RGB value;

and obtaining the writing track of the writing content according to the target area coordinates.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, before the obtaining the target RGB values corresponding to the pixel points of the text position in the written page image, the method further includes:

receiving a dictation instruction;

acquiring dictation content corresponding to the dictation instruction and reading the dictation content;

and triggering the camera to shoot the paper writing page on which the user writes the dictation content to obtain a writing page image.

As an alternative implementation manner, in the first aspect of the embodiment of the present invention, the obtaining a writing trajectory of the written content according to the target area coordinates includes:

determining whether the font is a positive font or not according to the coordinate vector of the target area coordinate;

and when the font is a positive character, obtaining the writing track of the writing content according to the target area coordinate.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, before the when the written font is a normal font and the writing trajectory of the written content is obtained according to the target area coordinates, the method further includes:

when the font is a positive character, determining a preset writing area in the writing page image;

extracting the target area coordinates in the preset writing area from the target area coordinates to serve as coordinates of an undetermined area;

the obtaining of the writing track of the writing content according to the target area coordinates comprises:

and obtaining a writing track of the writing content according to the coordinates of the undetermined area.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, after obtaining the writing trajectory of the written content according to the target area coordinates, the method further includes:

judging whether the writing content corresponding to the writing track is matched with the dictation content or not;

if the two are matched, acquiring the next dictation content and reading the content;

if not, outputting a prompt voice and rereading the dictation content.

A second aspect of an embodiment of the present invention discloses an electronic device, which may include:

the color detection unit is used for acquiring a target RGB value corresponding to a pixel point of a text position in a written page image;

the coordinate detection unit is used for respectively detecting a first region coordinate corresponding to an R channel, a second region coordinate corresponding to a G channel and a third region coordinate corresponding to a B channel in the target RGB value;

the synthesis unit is used for carrying out comparison and synthesis processing on the first area coordinate, the second area coordinate and the third area coordinate to obtain a target area coordinate corresponding to the target RGB value;

and the content acquisition unit is used for acquiring the writing track of the writing content according to the target area coordinates.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:

the reading reporting unit is used for receiving the dictation instruction before the color detection unit acquires the target RGB value corresponding to the pixel point of the text position in the written page image, acquiring the dictation content corresponding to the dictation instruction and reading;

and the shooting unit is used for triggering the camera to shoot the paper writing page on which the user writes the dictation content to obtain a writing page image.

As an optional implementation manner, in a second aspect of the embodiment of the present invention, the content obtaining unit includes:

the positive and negative detection subunit is used for extracting a target coordinate corresponding to the written content from the target area coordinate and determining whether the font is a positive font or not according to a coordinate vector of the target coordinate;

and the content obtaining subunit is used for obtaining the writing content according to the writing track determined by the target coordinates when the font is the positive character.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:

an extracting unit, configured to determine a preset writing area in the writing page image when the writing font is a normal character and before the content obtaining subunit obtains the writing trajectory of the writing content according to the target area coordinate, and extract a target coordinate located in the preset writing area from the target coordinate, where the target coordinate is used as an undetermined coordinate;

and the content obtaining subunit is specifically configured to obtain the writing content according to the writing track determined by the undetermined coordinate.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:

the content judging unit is used for judging whether the writing content corresponding to the writing track is matched with the dictation content or not after the writing track of the writing content is obtained by the content obtaining unit according to the target area coordinate;

the reading and reporting unit is further configured to obtain and read the next dictation content when the determination result of the content determination unit is a match; and when the judgment result of the content judgment unit is not matched, outputting a prompt voice and re-reading the dictation content.

A third aspect of an embodiment of the present invention discloses an electronic device, which may include:

a memory storing executable program code;

a processor coupled with the memory;

the processor calls the executable program code stored in the memory to execute the writing track detection method disclosed by the first aspect of the embodiment of the invention.

A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium storing a computer program, where the computer program causes a computer to execute a writing trajectory detection method disclosed in the first aspect of the embodiments of the present invention.

A fifth aspect of embodiments of the present invention discloses a computer program product, which, when run on a computer, causes the computer to perform some or all of the steps of any one of the methods of the first aspect.

A sixth aspect of the present embodiment discloses an application publishing platform, where the application publishing platform is configured to publish a computer program product, where the computer program product is configured to, when running on a computer, cause the computer to perform part or all of the steps of any one of the methods in the first aspect.

Compared with the prior art, the embodiment of the invention has the following beneficial effects:

in the embodiment of the invention, after acquiring a writing page image, an electronic device acquires a target RGB value corresponding to a pixel point at a text position in the writing page image, then detects region coordinates of an R channel, a G channel and a B channel by channels to respectively acquire a first region coordinate, a second region coordinate and a third region coordinate, and then performs comparison and synthesis processing on the first region coordinate, the second region coordinate and the third region coordinate to acquire a target region coordinate corresponding to the RGB value, namely acquiring a writing track of writing content; it can be seen that, in the embodiment of the present invention, the electronic device can directly determine the writing track of the written content through the RGB channel by using the color, i.e., the RGB value, of the text font in the written page image, thereby improving the detection accuracy of the writing track and the recognition rate of the writing result.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic flow chart of a writing trajectory detection method according to an embodiment of the present invention;

FIG. 2 is a schematic flow chart illustrating a writing trajectory detection method according to another embodiment of the disclosure;

FIG. 3 is a schematic flow chart illustrating a writing trajectory detection method according to another embodiment of the disclosure;

fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure;

FIG. 5 is a schematic structural diagram of an electronic device according to another embodiment of the disclosure;

FIG. 6 is a schematic structural diagram of an electronic device according to another embodiment of the disclosure;

fig. 7 is a schematic structural diagram of an electronic device according to still another embodiment of the disclosure.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that the terms "first", "second", and "third" in the description and claims of the present invention are used for distinguishing different objects, and are not used for describing a specific order. The terms "comprises," "comprising," and any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The embodiment of the invention discloses a writing track detection method which can detect a writing track according to the color of a text font, improve the detection accuracy of the writing track and improve the recognition rate of a writing result. The embodiment of the invention also correspondingly discloses the electronic equipment.

The electronic device according to the embodiment of the present invention includes, but is not limited to, a family education machine, a tablet computer, and the like, and the operating system of the electronic device may include, but is not limited to, an Android operating system, an IOS operating system, a Symbian operating system, a Black Berry operating system, a Windows Phone8 operating system, and the like. The technical solution of the present invention will be described in detail through specific embodiments from the perspective of electronic devices.

Example one

Referring to fig. 1, fig. 1 is a schematic flow chart of a writing trace detection method according to an embodiment of the present invention; as shown in fig. 1, the writing trace detection method may include:

101. the electronic equipment acquires a target RGB value corresponding to a pixel point at a text position in a written page image.

The writing page image may be a writing page shot after the user writes the dictation content in the dictation scene, or a writing page used by the user for searching, which is not limited in the embodiment of the present invention. When the writing page image is an image obtained by shooting a paper writing page, for example, the text content in the writing page image includes dictation content written on the paper writing page by a student user (effective content written by the student user), interference content written by the student user carelessly (points, lines in any shape, and the like, and the part of the content is invalid content written by the student user, namely interference information), passthrough content, and the like.

It should be noted that, for the contents written by the student user (which may include written contents and/or interference contents), the RGB values of the pixel points at these content positions are the same. For example, a student user writes on a written page with a black gel pen, all the content written is black, and therefore the RGB values of black in the written page image are the same, where R, G and B are three component values of about 0.

102. And the electronic equipment respectively detects a first area coordinate corresponding to the R channel, a second area coordinate corresponding to the G channel and a third area coordinate corresponding to the B channel in the target RGB value.

In this case, an R channel, i.e., a first area coordinate in which an R component value is 0, a G channel, i.e., a second area coordinate in which a G component value is 0, and a B channel, i.e., a third area coordinate in which a B component value is 0 are detected, respectively.

103. And the electronic equipment compares and synthesizes the first area coordinate, the second area coordinate and the third area coordinate to obtain a target area coordinate corresponding to the target RGB value.

It can be understood that comparing and synthesizing the first region coordinates, the second region coordinates and the third region coordinates will obtain target region coordinates corresponding to the target RGB values. The target area coordinates may include coordinates of a location where the written content is located and coordinates of a location where the interference information is located.

104. And the electronic equipment acquires the writing track of the writing content according to the target area coordinates.

And recognizing the position coordinates of the written content from the target area coordinates, and acquiring a writing track according to the position coordinates to acquire the written content.

It can be seen that, with the implementation of the above embodiment, after the electronic device acquires the written page image, the electronic device acquires the target RGB values corresponding to the pixel points at the text position in the written page image, then the sub-channels detect the region coordinates of the R channel, the G channel, and the B channel, respectively acquire the first region coordinate, the second region coordinate, and the third region coordinate, and then perform the comparison and synthesis processing on the first region coordinate, the second region coordinate, and the third region coordinate, acquire the target region coordinates corresponding to the RGB values, and thus, the writing trajectory of the written content can be acquired; it can be seen that, in the embodiment of the present invention, the electronic device can directly determine the writing track of the written content through the RGB channel by using the color, i.e., the RGB value, of the text font in the written page image, thereby improving the detection accuracy of the writing track and the recognition rate of the writing result.

Example two

Referring to fig. 2, fig. 2 is a schematic flow chart illustrating a writing trajectory detection method according to another embodiment of the disclosure; as shown in fig. 2, the writing trace detection method may include:

201 to 203.

Steps 201 to 203 are the same as steps 101 to 103 in the first embodiment, and are not described again here.

204. The electronic equipment determines whether the font of the written content is a normal character or not according to the coordinate vector of the target area coordinate; when the font of the written content is a normal character, go to step 205; when the written font is inverted, the process goes to step 206.

It can be understood that the target area coordinates are vector coordinates, the writing track can be determined according to the target area coordinates, and whether the font is a positive character or not is determined according to the writing track. In the embodiment of the invention, whether the font in the writing page image is the font of which the other side is overprinted is detected through the vector indication of the target area coordinate, if so, the contents are considered to be interference information and are not the writing contents (corresponding to the dictation mode, the dictation contents are written) written by the student user on the writing page.

205. And the electronic equipment acquires the writing track of the writing content according to the target area coordinates.

As an optional implementation manner, before determining that the font is a positive character and performing step 205, the electronic device is further configured to determine a preset writing area in the writing page image, extract a target area coordinate located in the preset writing area from the target area coordinate, serve as an undetermined area coordinate, and obtain a writing trajectory of the writing content according to the undetermined area coordinate.

As an optional implementation manner, the electronic device determines a writing track according to the target area coordinates, determines a font according to the writing track, extracts a normal word from the font, obtains writing content according to the normal word (in a corresponding dictation mode, the writing content is dictation content), and determines whether the writing content is correct. Therefore, the font can be directly determined according to the target area coordinates, the normal characters can be extracted from the font, the trace of the error writing or the reverse characters can be effectively removed, and the recognition rate of the writing content is improved.

206. The electronic equipment outputs prompt information which is used for reminding the user that the written content is not detected.

And prompting information to remind the user that the written content is not detected when the recognized font is a reverse character.

It can be seen that, by implementing the embodiment of the present invention, the electronic device can determine the written font by using the color, i.e., RGB value, of the text font in the written page image and through the RGB channel, and can exclude reverse characters (characters on the reverse side are printed on the front side), i.e., eliminate interference information, according to the font, thereby improving the detection accuracy of the writing track and the recognition rate of the writing result.

EXAMPLE III

Referring to fig. 3, fig. 3 is a schematic flow chart of a writing trace detection method according to another embodiment of the disclosure; as shown in fig. 3, the writing trace detection method may include:

301. the electronic device receives dictation instructions.

302. And the electronic equipment acquires the dictation content corresponding to the dictation instruction and reads the dictation content.

303. The electronic equipment triggers the camera to shoot a paper writing page on which the user writes the dictation content, and a writing page image is obtained.

When the electronic equipment is in a state of starting a dictation mode, the dictation instruction is received, the dictation content related to the dictation instruction is acquired and is reported in voice, and meanwhile, a built-in camera is opened to shoot a writing page.

Further, the electronic device receiving the dictation instruction may include: the electronic equipment receives a voice instruction of a user, wherein the voice instruction is used for indicating to read the corresponding dictation content, for example, if the corresponding dictation content is 'next', the next dictation content of the current dictation content is obtained and read, and if the corresponding dictation content is 'read again', the current dictation content is obtained and read again.

304. The electronic equipment acquires a target RGB value corresponding to a pixel point at a text position in a written page image.

305. The electronic equipment respectively detects a first area coordinate corresponding to an R channel, a second area coordinate corresponding to a G channel and a third area coordinate corresponding to a B channel in a target RGB value.

306. And the electronic equipment compares and synthesizes the first area coordinate, the second area coordinate and the third area coordinate to obtain a target area coordinate corresponding to the target RGB value.

307. And the electronic equipment acquires the writing track of the writing content according to the target area coordinates.

308. The electronic equipment judges whether the writing content corresponding to the writing track is matched with the dictation content or not; wherein if there is a match, then go to step 309; if not, go to step 310.

309. The electronic device obtains the next dictation and reads.

310. The electronic equipment outputs the prompt voice and rereads the dictation content.

As an optional implementation manner, after the writing content corresponding to the writing track is matched with the dictation content, the electronic device scores the writing content, acquires a current dictation value, determines whether the current dictation value reaches an end node, acquires all scores and calculates a total score when the current dictation value reaches the end node, and displays a preset robot and outputs voice information for presenting a user by using the preset robot when the total score is greater than or equal to the preset score. Through this embodiment, real-time monitoring dictation progress to through attracting user's robot to raise the user, be favorable to promoting user's interest in learning, increase the interest of dictation.

Further, the electronic device obtaining the current dictation progress value comprises:

detecting a dictation task in a dictation mode, wherein the dictation task indicates that all dictation contents to be dictated exist;

and acquiring the ratio of the number of the dictation contents which have been dictated to the number of all the dictation contents, wherein the ratio is used as a current dictation progress value indicating the dictation progress.

Furthermore, when the total score is greater than or equal to the preset score, the electronic equipment acquires the paid learning resources corresponding to the total score and provides the paid learning resources for the student users free, so that the student users can be further encouraged to learn well, and the learning efficiency is improved.

Optionally, the obtaining, by the electronic device, the paid learning resource corresponding to the total score for free provision to the student user includes:

acquiring and outputting a gift package interface corresponding to the total score, wherein the gift package interface at least comprises a central area and N lottery areas, the central area and the N lottery areas form a circle, the central area is positioned in the center of the circle, the N lottery areas are dispersedly arranged around the central area, the central area is used for displaying a gift package to be opened, and text information used for indicating the corresponding prize item level of the gift package is displayed on the lottery areas;

detecting the opening operation of a user on the gift bag to be opened displayed in the central area;

opening the gift bag to be opened in a preset animation mode in response to the opening operation, and simultaneously playing preset music;

after the gift bag to be opened is completely opened, displaying relevant information of target paid learning resources and a pickup button on a central area;

after the click operation of the user on the getting button is detected, adding the target paid learning resource into a purchased book list corresponding to the account information of the user, and displaying lottery drawing prompt information and a lottery drawing pointer in a central area, wherein one end of the lottery drawing pointer is positioned at the central point of the central area, and the other end of the lottery drawing pointer points to the lottery drawing area;

when the touch operation of a user on the central area is received, acquiring a touch pressure value corresponding to the touch operation, and controlling the lottery drawing pointer to rotate a target number of turns matched with the touch pressure value by taking the central point as a rotation point and rotating the lottery drawing pointer towards a preset direction;

and after the lottery drawing pointer rotates for the target number of turns and is static, acquiring a target lottery drawing area pointed by the lottery drawing pointer, and acquiring the lottery items in the target lottery drawing area to award the users.

Through the embodiment, the learning interest can be improved, and the learning efficiency is improved.

By implementing the embodiment, the electronic equipment can shoot the dictation content written by the user to obtain the writing page image, and performs RGB value analysis on the writing page image, which is beneficial to improving the detection accuracy of the dictation content.

Example four

Referring to fig. 4, fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure; as shown in fig. 4, the electronic device may include:

a color detection unit 410 for acquiring a target RGB value having a maximum occurrence probability in a text portion of a written page image;

a coordinate detecting unit 420, configured to detect a first region coordinate corresponding to the R channel, a second region coordinate corresponding to the G channel, and a third region coordinate corresponding to the B channel in the target RGB values, respectively;

a synthesizing unit 430, configured to perform synthesizing processing on the first region coordinates, the second region coordinates, and the third region coordinates to obtain target region coordinates corresponding to a target RGB value;

a content obtaining unit 440, configured to obtain a writing trajectory of the written content according to the target area coordinates.

Implementing the electronic equipment, after acquiring a writing page image, acquiring a target RGB value corresponding to a pixel point at a text position in the writing page image, detecting region coordinates of an R channel, a G channel and a B channel by channels, respectively acquiring a first region coordinate, a second region coordinate and a third region coordinate, then comparing and synthesizing the first region coordinate, the second region coordinate and the third region coordinate, acquiring a target region coordinate corresponding to the RGB value, and acquiring a writing track of writing content; it can be seen that, in the embodiment of the present invention, the electronic device can directly determine the writing track of the written content through the RGB channel by using the color, i.e., the RGB value, of the text font in the written page image, thereby improving the detection accuracy of the writing track and the recognition rate of the writing result.

EXAMPLE five

Referring to fig. 5, fig. 5 is a schematic structural diagram of an electronic device according to another embodiment of the disclosure; the electronic device shown in fig. 5 is optimized based on the electronic device shown in fig. 4, and the electronic device shown in fig. 5 further includes:

a reading unit 510, configured to receive a dictation instruction before the color detection unit 410 obtains a target RGB value corresponding to a pixel point at a text position in a written page image, and obtain and read dictation content corresponding to the dictation instruction;

and the shooting unit 520 is used for triggering the camera to shoot the paper writing page on which the user writes the dictation content, so as to obtain a writing page image.

Referring to fig. 5, the electronic device shown in fig. 5 may further include:

a content determining unit 530, configured to determine whether the writing content corresponding to the writing track matches the dictation content after the content obtaining unit 440 obtains the writing track of the writing content according to the target area coordinates;

the reading unit 510 is further configured to, when the determination result of the content determining unit 530 is a match, obtain a next dictation content and read; when the determination result of the content determination unit 530 is not matched, a prompt voice is output and the dictation content is re-reported.

As an optional implementation manner, the content determining unit 530 is further configured to score the writing content corresponding to the writing track after the writing content matches with the dictation content, acquire a current dictation progress value, determine whether the current dictation progress value reaches an end node, acquire all scores and calculate a total score when the current dictation progress value reaches the end node, and display a preset robot and output voice information for showing a user by using the preset robot when the total score is greater than or equal to a preset score. Through this embodiment, real-time monitoring dictation progress to through attracting user's robot to raise the user, be favorable to promoting user's interest in learning, increase the interest of dictation.

Further, the above-mentioned content judgment unit 530 for acquiring the current dictation progress value includes:

detecting a dictation task in a dictation mode, wherein the dictation task indicates that all dictation contents to be dictated exist;

and acquiring the ratio of the number of the dictation contents which have been dictated to the number of all the dictation contents, wherein the ratio is used as a current dictation progress value indicating the dictation progress.

Furthermore, when the total score is greater than or equal to the preset score, the content determination unit 530 is configured to obtain the paid learning resource corresponding to the total score and provide the paid learning resource to the student user free of charge, so that the student user can be further encouraged to learn well, and the learning efficiency is improved.

Alternatively, the content judgment unit 530 is configured to obtain the paid learning resource corresponding to the total score for free provision to the student user, and includes:

acquiring and outputting a gift package interface corresponding to the total score, wherein the gift package interface at least comprises a central area and N lottery areas, the central area and the N lottery areas form a circle, the central area is positioned in the center of the circle, the N lottery areas are dispersedly arranged around the central area, the central area is used for displaying a gift package to be opened, and text information used for indicating the corresponding prize item level of the gift package is displayed on the lottery areas;

detecting the opening operation of a user on the gift bag to be opened displayed in the central area;

opening the gift bag to be opened in a preset animation mode in response to the opening operation, and simultaneously playing preset music;

after the gift bag to be opened is completely opened, displaying relevant information of target paid learning resources and a pickup button on a central area;

after the click operation of the user on the getting button is detected, adding the target paid learning resource into a purchased book list corresponding to the account information of the user, and displaying lottery drawing prompt information and a lottery drawing pointer in a central area, wherein one end of the lottery drawing pointer is positioned at the central point of the central area, and the other end of the lottery drawing pointer points to the lottery drawing area;

when the touch operation of a user on the central area is received, acquiring a touch pressure value corresponding to the touch operation, and controlling the lottery drawing pointer to rotate a target number of turns matched with the touch pressure value by taking the central point as a rotation point and rotating the lottery drawing pointer towards a preset direction;

and after the lottery drawing pointer rotates for the target number of turns and is static, acquiring a target lottery drawing area pointed by the lottery drawing pointer, and acquiring the lottery items in the target lottery drawing area to award the users.

Through this embodiment, can improve the interest of study to improve learning efficiency.

EXAMPLE six

Referring to fig. 6, fig. 6 is a schematic structural diagram of an electronic device according to another embodiment of the disclosure; the electronic device shown in fig. 6 is optimized based on the electronic device shown in fig. 4, and in the electronic device shown in fig. 6, the content obtaining unit 440 may include:

a positive and negative detection subunit 610, configured to extract a target coordinate corresponding to the written content from the target area coordinate, and determine whether the font is a positive font according to a coordinate vector of the target coordinate;

a content obtaining sub-unit 620, configured to obtain the writing content according to the writing track determined by the target coordinates when the font is a positive character.

Further referring to fig. 6, the electronic device shown in fig. 6 further includes:

an extracting unit 630, configured to determine a preset writing area in the writing page image when the font is a positive character and before the content obtaining subunit 620 obtains the writing trajectory of the writing content according to the target area coordinates, and extract a target coordinate located in the preset writing area from the target coordinate, where the target coordinate is used as an undetermined coordinate;

the content obtaining subunit 620 is specifically configured to obtain the writing content according to the writing track determined by the undetermined coordinate.

In the above embodiment, the electronic device can determine the written font through the RGB channel by using the color of the text font in the written page image, that is, the RGB value, and can eliminate reverse characters (characters on the reverse side are printed on the front side) according to the font, that is, eliminate interference information, thereby improving the detection accuracy of the writing track and improving the recognition rate of the writing result.

EXAMPLE seven

Referring to fig. 7, fig. 7 is a schematic structural diagram of an electronic device according to another embodiment of the disclosure; the electronic device shown in fig. 7 may include: at least one processor 710, such as a CPU, a communication bus 730 is used to enable communication connections between these components. The memory 720 may be a high-speed RAM memory or a non-volatile memory (e.g., at least one disk memory). The memory 720 may optionally be at least one memory device located remotely from the processor 710. Wherein the processor 710 may be combined with the electronic device described in fig. 4 to 6, a set of program codes is stored in the memory 710, and the processor 710 calls the program codes stored in the memory 720 to perform the following operations:

acquiring a target RGB value corresponding to a pixel point of a text position in a written page image; respectively detecting a first region coordinate corresponding to an R channel, a second region coordinate corresponding to a G channel and a third region coordinate corresponding to a B channel in the target RGB value; synthesizing the first area coordinate, the second area coordinate and the third area coordinate to obtain a target area coordinate corresponding to the target RGB value; and obtaining the writing track of the writing content according to the target area coordinates.

As an alternative implementation, the processor 610 may be further configured to perform the following steps:

receiving a dictation instruction before acquiring a target RGB value corresponding to a pixel point of a text position in a written page image; acquiring dictation contents corresponding to the dictation instruction and reading the dictation contents; and triggering the camera to shoot the paper writing page on which the user writes the dictation content to obtain a writing page image. .

As an alternative implementation, the processor 610 may be further configured to perform the following steps:

determining whether the font is a positive font or not according to the coordinate vector of the target area coordinate; and when the font is a positive character, obtaining the writing track of the writing content according to the target area coordinates.

As an alternative implementation, the processor 610 may be further configured to perform the following steps:

when the font is a positive character, determining a preset writing area in the writing page image; extracting the target area coordinates in the preset writing area from the target area coordinates to serve as coordinates of an undetermined area; and obtaining the writing track of the writing content according to the coordinates of the undetermined area.

As an alternative implementation, the processor 610 may be further configured to perform the following steps:

after the writing track of the writing content is obtained according to the target area coordinates, whether the writing content corresponding to the writing track is matched with the dictation content is judged; if the two are matched, acquiring the next dictation content and reading the content; if not, outputting the prompt voice and rereading the dictation content. .

The embodiment of the invention also discloses a computer readable storage medium which stores a computer program, wherein the computer program enables a computer to execute the writing track detection method disclosed in the figures 1 to 3.

An embodiment of the present invention further discloses a computer program product, which, when running on a computer, causes the computer to execute part or all of the steps of any one of the methods disclosed in fig. 1 to 3.

An embodiment of the present invention further discloses an application publishing platform, where the application publishing platform is configured to publish a computer program product, where when the computer program product runs on a computer, the computer is enabled to execute part or all of the steps of any one of the methods disclosed in fig. 1 to fig. 3.

It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by instructions associated with a program, which may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), compact disc-Read-Only Memory (CD-ROM), or other Memory, magnetic disk, magnetic tape, or magnetic tape, Or any other medium which can be used to carry or store data and which can be read by a computer.

The writing track detection method and the electronic device disclosed by the embodiment of the invention are described in detail, a specific example is applied in the text to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (10)

1. A writing trajectory detection method is characterized by comprising the following steps:

acquiring a target RGB value corresponding to a pixel point of a text position in a written page image;

respectively detecting a first region coordinate corresponding to an R channel, a second region coordinate corresponding to a G channel and a third region coordinate corresponding to a B channel in the target RGB value;

comparing and synthesizing the first area coordinate, the second area coordinate and the third area coordinate to obtain a target area coordinate corresponding to the target RGB value;

and obtaining the writing track of the writing content according to the target area coordinates.

2. The method of claim 1, wherein prior to obtaining the target RGB values corresponding to the pixel points of the text location in the image of the written page, the method further comprises:

receiving a dictation instruction;

acquiring dictation content corresponding to the dictation instruction and reading the dictation content;

and triggering the camera to shoot the paper writing page on which the user writes the dictation content to obtain a writing page image.

3. The method of claim 1 or 2, wherein obtaining a writing trajectory of written content according to the target area coordinates comprises:

determining whether the font is a positive font or not according to the coordinate vector of the target area coordinate;

and when the font is a positive character, obtaining the writing track of the writing content according to the target area coordinate.

4. The method of claim 3, wherein before the writing font is a normal word and the writing trajectory of the written content is obtained according to the target area coordinates, the method further comprises:

when the font is a positive character, determining a preset writing area in the writing page image;

extracting the target area coordinates in the preset writing area from the target area coordinates to serve as coordinates of an undetermined area;

the obtaining of the writing track of the writing content according to the target area coordinates comprises:

and obtaining a writing track of the writing content according to the coordinates of the undetermined area.

5. The method of claim 2, wherein after obtaining the writing trajectory of the written content according to the target area coordinates, the method further comprises:

judging whether the writing content corresponding to the writing track is matched with the dictation content or not;

if the two are matched, acquiring the next dictation content and reading the content;

if not, outputting a prompt voice and rereading the dictation content.

6. An electronic device, comprising:

the color detection unit is used for acquiring a target RGB value corresponding to a pixel point of a text position in a written page image;

the coordinate detection unit is used for respectively detecting a first region coordinate corresponding to an R channel, a second region coordinate corresponding to a G channel and a third region coordinate corresponding to a B channel in the target RGB value;

the synthesis unit is used for carrying out comparison and synthesis processing on the first area coordinate, the second area coordinate and the third area coordinate to obtain a target area coordinate corresponding to the target RGB value;

and the content acquisition unit is used for acquiring the writing track of the writing content according to the target area coordinates.

7. The electronic device of claim 6, further comprising:

the reading reporting unit is used for receiving the dictation instruction before the color detection unit acquires the target RGB value corresponding to the pixel point of the text position in the written page image, acquiring the dictation content corresponding to the dictation instruction and reading;

and the shooting unit is used for triggering the camera to shoot the paper writing page on which the user writes the dictation content to obtain a writing page image.

8. The electronic device according to claim 6 or 7, wherein the content acquisition unit includes:

the positive and negative detection subunit is used for extracting a target coordinate corresponding to the written content from the target area coordinate and determining whether the font is a positive font or not according to a coordinate vector of the target coordinate;

and the content obtaining subunit is used for obtaining the writing content according to the writing track determined by the target coordinates when the font is the positive character.

9. The electronic device of claim 8, further comprising:

an extracting unit, configured to determine a preset writing area in the writing page image when the writing font is a normal character and before the content obtaining subunit obtains the writing trajectory of the writing content according to the target area coordinate, and extract a target coordinate located in the preset writing area from the target coordinate, where the target coordinate is used as an undetermined coordinate;

and the content obtaining subunit is specifically configured to obtain the writing content according to the writing track determined by the undetermined coordinate.

10. The electronic device of claim 7, further comprising:

the content judging unit is used for judging whether the writing content corresponding to the writing track is matched with the dictation content or not after the writing track of the writing content is obtained by the content obtaining unit according to the target area coordinate;

the reading and reporting unit is further configured to obtain and read the next dictation content when the determination result of the content determination unit is a match; and when the judgment result of the content judgment unit is not matched, outputting a prompt voice and re-reading the dictation content.

Images