CN111460134A

CN111460134A - Note extracting method of handwriting track, terminal and computer storage medium

Info

Publication number: CN111460134A
Application number: CN202010231860.1A
Authority: CN
Inventors: 程超
Original assignee: Ireader Technology Co Ltd; Zhangyue Technology Co Ltd
Current assignee: Ireader Technology Co Ltd; Zhangyue Technology Co Ltd
Priority date: 2020-03-27
Filing date: 2020-03-27
Publication date: 2020-07-28

Abstract

The invention relates to a note extracting method of a handwriting track, a terminal and a computer storage medium, wherein the reading terminal is used for displaying a page, and the method comprises the following steps: determining an identification range according to the part of the handwriting track mapped on the page, and abstracting an abstract according to the identification range; opening the note frame; acquiring classification information input in the note box by a user; and storing the abstract into the notes of the corresponding classification according to the classification information. The scheme of the invention can classify the abstracts, thereby being convenient for classification and storage.

Description

Note extracting method of handwriting track, terminal and computer storage medium

Technical Field

The invention relates to the technical field of information. More particularly, the present invention relates to a note extracting method of a handwritten trajectory, a terminal and a computer-readable storage medium.

Background

In recent years, electronic paper is becoming widely used, and the largest application is reading terminals, i.e. electronic book readers. The electronic book storage device is convenient to store and carry, can store the contents of thousands or even tens of thousands of electronic books, and is more environment-friendly and convenient to carry due to the characteristics.

In order to provide a better reading experience, reading terminals are often provided with a tag annotation. When reading the electronic book, the user is also used to mark important knowledge points, or add own knowledge after some knowledge points, so as to make later important learning. In order to facilitate sorting of notes scattered on pages of an electronic book and avoid repeated annotation, the prior art can collect the content marked by a user into a book, but only all the notes are collected and stored, so that systematic sorting is lacked, and specific annotation is not easy to search.

Disclosure of Invention

In order to at least partially solve the technical problems mentioned in the background, the invention provides a note extracting method of a handwriting track, a terminal and a computer storage medium.

In one aspect, the present invention provides a note extracting method for a handwriting track of a reading terminal, wherein the reading terminal is used for displaying a page, and the method comprises the following steps: determining an identification range according to the part of the handwriting track mapped on the page, and abstracting an abstract according to the identification range; opening the note frame; acquiring classification information input in the note box by a user; and storing the abstract into the notes of the corresponding classification according to the classification information.

In another aspect, the present invention provides an electronic device comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus; the memory is used for storing at least one executable instruction which causes the processor to execute the operation of the method.

In yet another aspect, the present invention provides a computer-readable storage medium having stored thereon computer program instructions for execution by one or more processors to perform operations that implement the aforementioned method.

In another aspect, the present invention provides an electronic device for note extraction of a handwriting trajectory of a reading terminal, comprising: the display is used for displaying a page and receiving a signal of a handwritten note; the processor is used for determining a recognition range according to the part of the handwriting track mapped on the page and abstracting an abstract according to the recognition range; a memory; wherein the processor opens a note box; the processor stores the abstract in a note of a corresponding classification according to the classification information.

When the technical scheme is used for extracting, the page-crossing content can be identified through the predefined symmetrical symbol group, the extraction is correctly carried out, then classification is carried out, and then filing and storage are carried out, wherein classification items can be automatically filled in by a user through a note box, and can also be automatically recommended by a system according to the presetting or habit of the user, so that the purpose of rapid classification is achieved.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

The above and other objects, features and advantages of exemplary embodiments of the present invention will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. In the accompanying drawings, several embodiments of the present invention are illustrated by way of example and not by way of limitation, and like reference numerals designate like or corresponding parts throughout the several views, in which:

FIG. 1 is a schematic diagram illustrating an electronic terminal according to an embodiment of the present invention;

FIGS. 2(a) and 2(b) are schematic diagrams illustrating reading pages according to embodiments of the invention;

FIG. 3 is a flow diagram illustrating a note excerpting method according to an embodiment of the present invention; and

FIG. 4 is a flowchart illustrating a page turning method for notes according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be understood that the terms "first", "second", "third" and "fourth", etc. in the claims, the description and the drawings of the present invention are used for distinguishing different objects and are not used for describing a particular order. The terms "comprises" and "comprising," when used in the specification and claims of this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It is also to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the specification and claims of this application, the singular form of "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should be further understood that the term "and/or" as used in the specification and claims of this specification refers to any and all possible combinations of one or more of the associated listed items and includes such combinations.

As used in this specification and claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to a determination" or "in response to a detection". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".

The technical scheme of the invention provides a technical scheme of note extraction on the whole. Different from the prior art, the user can only directly output and store the edited note abstract. The invention mainly provides a function of quickly classifying the abstracts, and classifies the identification areas by identifying the handwriting tracks so as to achieve the purpose of classifying and archiving the abstracts.

The following detailed description of embodiments of the invention refers to the accompanying drawings.

An embodiment of the present invention is an electronic terminal, and fig. 1 shows a schematic diagram of the electronic terminal.

As shown in fig. 1, the reading terminal 100 includes: a processor 101, a communication interface 102, a power component 103, a display 104, an audio component 105, a memory 106, and a key interface 107.

The processor 101 may be a central processing unit CPU or a specific integrated circuit ASIC or an integrated circuit configured to implement an embodiment of the invention. Furthermore, the reading terminal 100 can include multiple processors, which can be of the same type or different types of processors, such as multiple CPUs, multiple ASICs, or a CPU plus an ASIC.

The communication interface 102 is configured as a module for wireless communication between the reading terminal 100 and other devices, including bluetooth 112,

WiFi antenna

122, 4G/5G antenna communication 132, and the like. In another embodiment, the communication interface 102 further includes a Near Field Communication (NFC) module to facilitate short-range communications.

The power supply component 103 provides power to the various components of the reading terminal 100. The power supply assembly 103 may include an external power interface 113 and a charging interface circuit 123.

The display 104 is an interactive display interface between the reading terminal 100 and the user, and includes an electromagnetic film 114, a capacitive screen 124, an ink screen 134, and the like.

The electromagnetic film 114 is used for receiving signals of an electromagnetic pen, and is distinguished by magnetic field changes generated by inductors under an electromagnetic pen operating process and a panel, the electromagnetic pen is a signal transmitting end, the electromagnetic film 114 is a signal receiving end, when the electromagnetic pen is close to induction, magnetic flux changes, and position points are defined through operation.

The capacitive screen 124 is a touch screen for receiving signals from a user's finger input and includes one or more touch sensors to sense gestures on the touch, slide and touch screen panels. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

The electromagnetic film 114 and the capacitive screen 124 are collectively referred to as a touch screen.

The ink screen 134 is a screen using electronic ink, also called electronic paper display technology, and has a main structure including a top transparent electrode layer, an electrophoretic layer, and a bottom electrode pixel layer. The electrophoretic layer is internally provided with a plurality of fine microcapsules, the microcapsules are provided with transparent liquid and a plurality of tiny electrophoretic particles, the electrophoretic particles are distributed in the transparent electrophoretic liquid to form a suspension system, the surfaces of the electrophoretic particles are easy to adsorb electric charges, and the particles capable of inducing the electric charges can move under the action of an external electric field.

Specifically, the electrophoretic particles are classified into negatively charged black particles and positively charged white particles. When a positive voltage is applied to the bottom electrode pixel layer, the white particles are repelled to move toward the top transparent electrode layer, and the black particles are attracted to move toward the bottom electrode pixel layer, in which case the pixel appears white. Conversely, when a negative voltage is applied to the bottom electrode pixel layer, the white particles are attracted to move toward the bottom electrode pixel layer, the black particles are repelled to move toward the top transparent electrode layer, and the pixel is displayed as black.

The display 104 also includes a sensing component 144 configured with a plurality of various sensors for providing various aspects of status assessment for the electronic device. For example: the temperature sensor 154 in the sensing element 144 can detect the temperature change of the display 104, and the detected temperature is transmitted to the processor 101 and then to the timing controller 108 as a parameter for table lookup.

The display 104 further includes a front light and light guide plate 164 disposed at a side of the display 104 to provide a stable and uniform light source.

The audio component 105 is configured to output and/or input audio signals. For example, the audio component 105 includes a microphone 118, and when the reading terminal 100 needs to receive speech, such as a call mode, a recording mode, and a speech recognition mode, the microphone 118 is configured to receive external audio signals. The audio assembly 128 also includes a speaker 128 for outputting audio signals.

The memory 106 is used for storing programs, electronic books and notes, and may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as a disk memory.

The key interface 107 is used for controlling the page turning of the user, and is generally physical keys, which are disposed at the side of the reading terminal 100 and include a front page turning key and a back page turning key.

The timing controller 108 is used for finding out the corresponding control parameter, i.e. the driving waveform, through the lookup table. Since the black and white particles in the ink screen 134 are sensitive to temperature, the lower the temperature, the less active the particles, the longer it takes to move to the same position in the microcapsule at room temperature; the particles move faster when the temperature is higher, and the time required to move to the same location in the microcapsule is relatively shorter compared to the time required at normal temperature. The temperature sensor 154 collects temperature data on the display 104, and the timing controller 108 finds corresponding control parameters according to the temperature data to select an appropriate driving waveform.

The display driver 109 converts the driving waveform into a control signal to drive the ink particles on the ink screen 134 to move, so that image data to be displayed can be imaged on the ink screen 134.

In this embodiment, when a user wants to edit notes or summarize for a specific content of the electronic book, a handwriting track is input on the display 104 by a magnetic pen, wherein the handwriting track can be formed by drawing lines, circling or similar text selection methods commonly used in handwriting operation on a specific area of a reading page, the magnetic film 114 transmits an electromagnetic signal to the processor 101, and the processor 101 determines a recognition range of the circling according to a portion of the handwriting track mapped on the page. Specifically, the handwriting track is formed by connecting a plurality of handwriting points in series, and the recognition range, namely the excerpt range selected by the user, can be determined by connecting all the position coordinates in series through the position coordinate corresponding to the page of each handwriting point.

In one scenario, as shown in fig. 2(a), when the handwritten trace 201 is formed in a line drawing manner, the processor 101 intercepts the complete information of the line drawing content and analyzes it appropriately to extract the appropriate range. The processor 101 will incorporate a specific number of characters at the beginning and end of the line into the recognition area to combine the meaningful phrases in the recognition analysis area, and completely cover the meaningful phrases into the abstract. In this scenario, for example, if the user underlines the "no, no difference" mark, the processor 101 covers the beginning and the end of the mark portion with 2 characters, i.e. the "ascend no, no difference. If, after semantic analysis, the processor 101 should automatically associate the starting point to "ascend", and obtain the abstract of the complete sentence as "ascend penalties and no difference is applicable".

In another scenario, as shown in fig. 2(b), when the handwriting track 202 is formed in a circle-selection manner, the processor 101 expands outwards in four directions, namely, the upper direction, the lower direction, the left direction, the right direction, and the left direction, taking the circle-selection range of the handwriting track as a center, to form a circumscribed rectangle 203, the processor 101 determines the coverage range of the circumscribed rectangle 203, and the processor 101 determines the characters covered by the circumscribed rectangle 203 as the abstract of the excerpt.

In another scenario, this embodiment may further confirm that the user circle is not a false touch. When the user draws a handwritten trace 302 as shown in fig. 2(b) with his hand on the display 104, the handwritten trace is detected by the capacitive screen 124. The capacitive screen 124 transmits the handwriting signal to the processor 101, the processor 101 identifies the circled area on the current reading page, and further determines whether the same area of the capacitive screen 124 is continuously pressed, if so, the user really selects the text of the area, and the text is not mistakenly touched, that is, after the user completes the circled operation, the circled area is continuously pressed to start the task of identifying the circled area.

The processor 101 obtains coordinate values in four directions, i.e., up, down, left, and right, outward based on the selection range of the handwriting trace 202 to form a circumscribed rectangle 203, and then the processor 101 recognizes characters in the circumscribed rectangle 203 to determine whether the characters have a complete meaning. If so, the processor 101 transmits a signal to the timing controller 108 for table lookup, and the timing controller 108 outputs a control signal to the display driver 109, so as to drive the ink screen 134 to display the circumscribed rectangle 203 covering the handwritten trace 202. All the characters of the page corresponding to the circumscribed rectangle 203 are the abstracts to be extracted.

Next, the processor 101 stores the text in the circumscribed rectangle 203 into the memory 106 and drives the ink screen 134 to display a note box for the user to input the classification information of the summary. Specifically, the page pops up a note box to be placed on the upper layer of the current reading page, so that the user can input information such as the title and the keywords of the abstract by handwriting. The summary is determined to be a note, and the processor 101 classifies the summary into the note of the corresponding classification according to the classification information and stores the note in the memory 106.

In another scenario, to provide functionality for cross-page selection of content or more precisely selection of content to be excerpted, this embodiment provides as a selection tool a set of symmetric symbols comprising a first symbol and a second symbol. For example, the commonly used quotation marks: the left symbols of these symmetrical symbol sets are the first symbol, and the right symbol is the second symbol. The user can input a first symbol at the beginning of the abstract to be selected by handwriting, and input a corresponding second symbol at the end of the character to be selected, and the touch screen returns the coordinate values of the first symbol and the second symbol to the processor 101. The processor 101 obtains a first symbol mapping at a first position of the page and obtains a second symbol mapping at a second position of the page, and identifies content on the page between the first position and the second position as a summary.

When the user wants to select a range to cross pages, the user can hand write a first symbol on the current page, the touch screen acquires the coordinate value of the first symbol, so that the processor 101 acquires a first position, then the user presses the key interface 107, or the processor 101 recognizes a page-turning signal to turn pages by long pressing a specific position preset by the reading terminal 100 on the display 104, the user inputs a second symbol at the end of the range to be selected after the pages are turned, the touch screen acquires the coordinate value of the second symbol, so that the processor 101 acquires a second position, and the character between the first position and the second position is recognized as an abstract. The first position can be set by the reading terminal 100, and in this embodiment, the predetermined specific position can be the last word of the line, segment or page where the first position is located.

Then, as mentioned above, a note box pops up on the display page of the display screen 104 for the user to input the classification information of the abstract, and the processor 101 classifies the abstract into the note of the corresponding classification according to the classification information and stores the note in the memory 106.

FIG. 3 is a flow diagram illustrating a note excerpting method 300 according to an embodiment of the present invention. The reading terminal of this embodiment is used to display a page, where the reading terminal may be a mobile terminal for displaying an electronic book, such as a mobile phone, a tablet computer, an e-reader, but is not limited thereto, and may also be another terminal.

As shown in fig. 3, this embodiment includes the following steps:

at step 301, a recognition range is determined according to the handwriting track mapping on the part of the page, and an abstract is extracted according to the recognition range.

When a user abstracts specific contents of the electronic book, a handwriting track is input by a magnetic pen, wherein the handwriting track can be formed by drawing or selecting a specific area of a reading page, and the method 300 determines a recognition range according to the part of the page mapped by the handwriting track. Specifically, the handwriting track is formed by connecting a plurality of handwriting points in series, and the recognition range, namely the summary range selected by the user, can be determined by judging the position coordinates of each handwriting point corresponding to the page and connecting all the position coordinates in series.

As in the previous embodiment, this embodiment can also incorporate a specific number of characters at the beginning and end of the circled portion into the recognition range to combine the meaningful phrases in the recognition analysis range, and completely cover the meaningful phrases into the abstract. The specific operation manner is the same as the corresponding description of fig. 2(a) and 2(b), and is not repeated.

At step 302, the note box is opened.

The method 300 stores the text in the summary range selected by the user in a picture format and opens a note box for the user to input the classification information of the summary.

At step 303, the classification information entered at the note box by the user is obtained.

Specifically, a note box is popped up from the page, so that the user can input information such as the title and the keywords of the abstract by handwriting. In one scenario, the method 300 may also find keywords of the summary after semantic analysis according to the characters in the summary range selected by the user, recommend one or more suitable classification items, and display the recommended classification items in the note box for the user to select. For example, the system side is provided with a classification table, which includes a plurality of categories and keywords corresponding to the categories, and the classification table is displayed in the reading terminal, for example: when the keyword is a name of a person, the classification item recommended by the reading terminal is a character category; for another example, the keywords are display and touch, and the classification items recommended by the reading terminal are touch technology categories. The foregoing description is exemplary only, and the classification table is not limited to the foregoing classification items and keywords. Optionally, the category list can be added or modified by the user.

In another scenario, the note box may include a shortcut key linked to the category list, the user may click the shortcut key, the page may pop up the category list, and the appropriate category item may be selected by directly searching the category list.

At step 304, the summary is stored in the note of the corresponding classification according to the classification information.

Based on the classification information selected by the user, the method 300 classifies the summary into the corresponding classification for storage.

FIG. 4 is a flow diagram illustrating a page turn method 400 of a note according to another embodiment of the invention.

As shown in fig. 4, this embodiment includes the following steps:

at step 401, a first symbol map is obtained at a first location of a page.

This embodiment provides a symmetric symbol set as a selection tool for the cross-page summary. The symmetric symbol group comprises a first symbol and a second symbol, wherein the left symbol of the symmetric symbol group is the first symbol, and the right symbol of the symmetric symbol group is the second symbol. The user may handwriting a first symbol at the beginning of the text to be selected, and the method 400 receives the first symbol to obtain a first symbol mapping at a first position of the page. Specifically, a user inputs a first symbol in a current page by handwriting, and the reading terminal acquires a first position mapped on the page.

At step 402, a second symbol map is obtained at a second location of the page.

The user then enters a second symbol at the end of the word to be selected. The method 400 receives the second symbol to obtain a second symbol mapping at a second location of the page. Specifically, the user may handwriting the second symbol on the current page, and the reading terminal obtains the second symbol mapped on the page.

At step 403, the content of the page between the first location and the second location is determined as an identification range and stored as a summary.

In addition, a computer-readable storage medium is also disclosed, comprising a computer program for executing a note-taking of a handwritten trajectory, which, when executed by a processor, performs the method according to the method described in connection with fig. 3 and 4 and embodiments thereof.

It should also be appreciated that any module, unit, component, server, computer, terminal, or device executing instructions exemplified herein may include or otherwise have access to a computer-readable medium, such as a storage medium, computer storage medium, or data storage device (removable and/or non-removable) such as a magnetic disk, optical disk, or tape. Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules or other data.

Examples of computer storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by an application, a module, or both. Any such computer storage media may be part of, or accessible or connectable to, a device. Any application or module described herein may be implemented using computer-readable/executable instructions stored or otherwise maintained by such computer-readable media.

According to the technical scheme, when the original text content is extracted, the extracted part is regarded as a note, and the note can be classified and then archived for storage, wherein classification items can be filled in by a user through a note window, and can also be automatically recommended by a system according to the presetting or habits of the user, so that the purpose of effectively managing the note is achieved. In addition, the cross-page content can be identified through a predefined symmetric symbol set, and the original text content is completely extracted.

Although the embodiments of the present invention are described above, the descriptions are only examples for facilitating understanding of the present invention, and are not intended to limit the scope and application scenarios of the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A note excerpting method for a handwriting track of a reading terminal, wherein the reading terminal is used for displaying a page, and the method comprises the following steps:

determining an identification range according to the part of the handwriting track mapped on the page, and abstracting an abstract according to the identification range;

opening the note frame;

acquiring classification information input in the note box by a user; and

and storing the abstract into the notes of the corresponding classification according to the classification information.

2. The note excerpt method of claim 1, wherein the handwritten trajectory includes a set of symmetric symbols including a first symbol and a second symbol, the step of excerpting a summary in accordance with the recognition range including:

acquiring a first position of the first symbol mapping on the page;

acquiring a second position of the second symbol mapping on the page;

and determining the content of the page between the first position and the second position as an identification range and storing the content as the abstract.

3. The note excerpting method of claim 2, wherein the excerpting step further comprises:

and responding to the acquired first position and receiving a page turning instruction.

4. The note excerpt method of claim 3, wherein the page flip instruction is a last tail word of a row, segment, or page that is held in the first position.

5. An electronic device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is for storing at least one executable instruction that causes the processor to perform the operations of the method of any of claims 1-4.

6. A computer-readable storage medium having computer program instructions stored thereon that are executed by one or more processors to perform operations that implement the method of any of claims 1 to 4.

7. An electronic device for note taking of a handwriting trajectory of a reading terminal, the electronic device comprising:

the display is used for displaying a page and receiving a signal of a handwritten note;

the processor is used for determining a recognition range according to the part of the handwriting track mapped on the page and abstracting an abstract according to the recognition range;

a memory;

wherein the processor opens a note box;

the processor stores the abstract in a note of a corresponding classification according to the classification information.

8. The electronic device of claim 7, wherein the handwritten trace includes a set of symmetric symbols, the set of symmetric symbols including a first symbol and a second symbol, the display obtains a first position of the mapping of the first symbol on the page and obtains a second position of the mapping of the second symbol on the page, and the processor determines content of the page between the first position and the second position as an identification range and stores the content as the summary.

9. The electronic device of claim 8, wherein the processor receives a page flip instruction in response to obtaining the first location at a time of the snippet.

10. The electronic device of claim 9, wherein the page flip instruction is a last end word of a row, segment, or page that is long pressed at the first position.