CN112035031A - Note generation method and device, electronic equipment and storage medium - Google Patents
Note generation method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112035031A CN112035031A CN202010899602.0A CN202010899602A CN112035031A CN 112035031 A CN112035031 A CN 112035031A CN 202010899602 A CN202010899602 A CN 202010899602A CN 112035031 A CN112035031 A CN 112035031A
- Authority
- CN
- China
- Prior art keywords
- note
- interface element
- information
- interface
- content
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present disclosure relates to a note generating method, device, electronic device and storage medium, wherein the note generating method is applied to a terminal device, and comprises: determining an information extraction page according to the note generation command; acquiring a plurality of interface elements of the information extraction page, and determining the text description information of each interface element; acquiring the indexing content of each interface element; and generating at least one corresponding note and the category of the note according to the indexing content and the text description information of each interface element. All display pages can be identified, and the requirement of a user for acquiring information under any situation is met; and notes of various categories can be generated aiming at each interface element, so that the requirement of a user on obtaining information of various categories is met. The efficiency, the coverage and the pertinence of the user for acquiring the information are improved as a whole.
Description
Technical Field
The disclosure relates to the technical field of terminal equipment, in particular to a note generation method and device, electronic equipment and a storage medium.
Background
With the progress of science and technology, the channels for people to acquire information are evolved from traditional media such as newspapers, books, broadcasting and the like to electronic propagation media, and even many users have taken the display page of the terminal device as the only source for acquiring information. The complexity of information in a display page of the terminal device is far from the comparison with the traditional media, so that in order to enable a user to quickly obtain key information and improve the information obtaining efficiency, the terminal device needs to automatically generate summary or reminding information such as notes according to the information in the page, but in the related technology, only certain specific pages can be identified, and only notes related to schedules can be generated, so that the requirement of the user on information obtaining is far from being met.
Disclosure of Invention
In order to overcome the problems in the related art, embodiments of the present disclosure provide a note generation method, device, electronic device, and storage medium, so as to solve the defects in the related art.
According to a first aspect of the embodiments of the present disclosure, a note generation method is provided, which is applied to a mobile terminal, and the method includes:
determining an information extraction page according to the note generation command;
acquiring a plurality of interface elements obtained by dividing the information extraction page, and determining the text description information of each interface element;
acquiring the indexing content of each interface element;
and generating at least one corresponding note according to the indexing content and the text description information of each interface element, and labeling the category of each note.
In one embodiment, the information extraction page includes at least one control element;
the obtaining of the plurality of interface elements of the information extraction page includes:
dividing the information extraction page by taking the boundary of the adjacent control elements as a dividing line to obtain at least one control element;
and taking at least one control element as an interface element.
In one embodiment, determining textual description information for each of the interface elements includes:
and identifying text content contained in the interface element, and determining the character description information of the interface element according to the text content.
In one embodiment, determining textual description information for each of the interface elements includes:
and identifying image content contained in the interface element, and determining the text description information corresponding to the interface element according to the image content.
In one embodiment, the obtaining of the index content of each interface element includes:
acquiring a screenshot of the interface element; and/or
And acquiring the link information contained in the interface element.
In one embodiment, the generating at least one corresponding note and the category of the note according to the indexing content and the text description information of each interface element includes:
determining at least one note type corresponding to the interface element according to the type of the application program to which the text description information and/or the information extraction page belongs;
generating notes of each of the at least one note type based on the indexing content.
In one embodiment, further comprising:
acquiring time when the note generation command is received;
and generating the generation time of each note according to the acquired time label.
In one embodiment, further comprising:
generating a note screening interface according to all the generated notes and the corresponding categories;
and acquiring a screening operation input based on the note screening interface, and storing at least one note according to the screening operation.
In one embodiment, further comprising:
and if the at least one saved note has a note with the category of schedule, generating corresponding reminding information according to the note with the category of schedule, wherein the reminding information is used for reminding a user to pay attention to the schedule after the time related to the schedule is reached.
According to a second aspect of the embodiments of the present disclosure, there is provided a note generating apparatus applied to a mobile terminal, the apparatus including:
the page acquisition module is used for determining an information extraction page according to the note generation command;
the interface processing module is used for obtaining a plurality of interface elements of the information extraction page and determining the text description information of each interface element;
the content acquisition module is used for acquiring the indexing content of each interface element;
and the note generating module is used for generating at least one corresponding note and the type of the note according to the indexing content and the character description information of each interface element.
In one embodiment, the information extraction page includes at least one control element;
the interface processing module is specifically configured to:
dividing the information extraction page by taking the boundary of the adjacent control elements as a dividing line to obtain at least one control element;
and taking at least one control element as an interface element.
In one embodiment, the interface processing module is specifically configured to:
and identifying text content contained in the interface element, and determining the character description information of the interface element according to the text content.
In one embodiment, the interface processing module is specifically configured to:
and identifying image content contained in the interface element, and determining the text description information corresponding to the interface element according to the image content.
In one embodiment, the content obtaining module is specifically configured to:
acquiring a screenshot of the interface element; and/or
And acquiring the link information contained in the interface element.
In one embodiment, the note generation module is specifically configured to:
determining at least one note type corresponding to the interface element according to the type of the application program to which the text description information and/or the information extraction page belongs;
generating notes of each of the at least one note type based on the indexing content.
In one embodiment, the system further comprises a time annotation module for:
acquiring time when the note generation command is received;
and generating the generation time of each note according to the acquired time label.
In one embodiment, the system further comprises a note storage module for:
generating a note screening interface according to all the generated notes and the corresponding categories;
and acquiring a screening operation input based on the note screening interface, and storing at least one note according to the screening operation.
In one embodiment, the system further comprises a schedule processing module for:
and if the at least one saved note has a note with the category of schedule, generating corresponding reminding information according to the note with the category of schedule, wherein the reminding information is used for reminding a user to pay attention to the schedule after the time related to the schedule is reached.
According to a third aspect of embodiments of the present disclosure, there is provided an electronic device comprising a memory for storing computer instructions executable on a processor, the processor being configured to perform the note generating method according to any one of the first aspect when executing the computer instructions.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any one of the first aspects.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
according to the note generation method provided by the disclosure, when a note generation command of a user is received, a current page is obtained as an information extraction page, then the text description information of interface elements of the information extraction page is determined, the indexing content of each interface element is obtained, and finally notes and categories are generated according to the text description information and the indexing content. Because the user can input the note generation command under any display interface, all display pages of the terminal equipment can be identified, and the requirement of the user for acquiring information under any situation is met; in addition, the text description information and the indexing content corresponding to the interface elements are respectively obtained, and notes of at least one type can be generated for each interface element according to the text description information and the indexing content, so that the requirements of users on obtaining information of various types are met, and the efficiency, the coverage range and the pertinence of the users for obtaining the information are integrally improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
FIG. 1 is a flow chart diagram illustrating a note generation method according to an exemplary embodiment of the present disclosure;
FIG. 2 is a flow chart diagram of a note generation method shown in another exemplary embodiment of the present disclosure;
FIG. 3 is a schematic structural diagram of a note generation device according to an exemplary embodiment of the disclosure;
fig. 4 is a block diagram of an electronic device shown in an exemplary embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
With the progress of science and technology, the channels for people to acquire information are evolved from traditional media such as newspapers, books, broadcasting and the like to electronic propagation media, and even many users have taken the display page of the terminal device as the only source for acquiring information. The complexity of information in a display page of the terminal device is far from the comparison with the traditional media, so that in order to enable a user to quickly obtain key information and improve the information obtaining efficiency, the terminal device needs to automatically generate summary or reminding information such as notes according to the information in the page, but in the related technology, only certain specific pages can be identified, and only notes related to schedules can be generated, so that the requirement of the user on information obtaining is far from being met.
Specifically, in the related art, only the content related to the plan and the trip in the chat page in the social software can be identified, and the schedule note is generated according to the identification result. When the chat page is identified, different chat sentences in the page need to be checked reversely, so that complete plans and strokes can be identified, the operation efficiency is low, the convenience is low, and the user experience is poor.
Based on this, at least one embodiment of the present disclosure provides a note generation method applied to a terminal device, please refer to fig. 1, which shows a flow of the note generation method, including steps S101 to S104.
The terminal device may be a smart phone, a tablet computer, a desktop/laptop/handheld computer, a notebook computer, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a Personal Digital Assistant (PDA), an Augmented Reality (AR)/Virtual Reality (VR) device, and the like, which include a display screen or a device capable of performing interface display, and embodiments of the present disclosure are not intended to limit the specific form of the terminal device.
In addition, the terminal device has related components for command collection, such as a touch screen, which can collect touch operation input by a user on the touch screen, a microphone, which can collect voice command input by the user on the microphone, a keyboard, which can collect typing operation input by the user on the keyboard, a mouse, which can collect clicking operation input by the user on the mouse.
In step S101, the information extraction page is determined according to the memo generation command.
In this step, when a user uses the terminal device, various display pages appear, when the display pages have information required by the user, the user can input a note generation command at any time, and when the note generation command is obtained, the page to which the user's command is directed needs to be locked in real time, so that the pertinence and accuracy of subsequent information extraction and note generation are improved; the page when the command is received may be acquired as an information extraction page, for example, the page currently displayed on the display screen may be directly intercepted and temporarily stored while the command is received, so as to be subjected to subsequent processing, and another page to which the content in the command is directed may be acquired as an information extraction page, for example, the semantics of the page to which the content is directed is identified while the command is received, and the display page corresponding to the semantics is acquired from a processor (CPU) or a display driver module (GPU) during subsequent processing.
The note generation command may be a command corresponding to a touch operation input based on a touch screen, a voice control command input based on a microphone, a command corresponding to a key input based on a keyboard, or a command corresponding to a click operation input based on a mouse, which is not limited in this disclosure.
In step S102, a plurality of interface elements of the information extraction page are obtained, and the textual description information of each interface element is determined.
The interface elements in the information extraction page can be directly obtained, or the information extraction page can be divided to obtain the interface elements. In terms of the dividing mode, the screen can be divided in equal proportion to realize the equal division of the screen; the screen can also be divided in unequal proportion to realize unequal division of the screen, for example, the screen can be divided according to effective identification areas, so that each divided part corresponds to one effective identification area.
In some embodiments, the display interface may be segmented with boundaries of adjacent control elements as segmentation lines to obtain at least one control element, and then the at least one control element is used as one interface element. The display interface comprises at least one control element, the control element can be navigation characters, icons, combinations of the characters and the icons and the like, in the combinations of the characters and the icons, the icons can be control element bodies, and the characters can be corresponding marks; the control information in the page can be directly acquired by using a page processing tool in a system of the terminal equipment, and the control information at least comprises any one of the following items: with regard to the number (ID), position, attribute, and the like of each control element in the page, for example, in the Android system, the access availability Service of the system itself can be used to obtain the control information in the page. The control elements are used as the units for division, so that each divided interface element is an independent information unit, the independent character description information is provided, the character description information is complete, the interface display segmentation efficiency and accuracy are improved, and the note subsequent generation efficiency and accuracy are improved.
In some embodiments, the treating at least one control element as an interface element includes: and taking at least one control element of the same type and/or at least one control element indicating the same message source as an interface element.
In this embodiment, at least one control element of the same type may be used as an interface element, at least one control element indicating the same message source may be used as an interface element, or at least one control element of the same type and indicating the same message source may be used as an interface element. The interface element is used as an independent information unit, and not only has independent character description information, but also the character description information is complete. For example, in a chat page, a plurality of dialog box type control elements of the same chat object can be used as one interface element, and the text description information corresponding to the interface element is determined, so that the recognition of the text description information corresponding to each dialog box control of the same chat object can be omitted, and the recognition efficiency, the integrity and the accuracy of the text description information are improved. For another example, in a chat interface, a text dialog box and a plurality of control elements of a picture and a voice message of the same chat object may be used as one interface element, and text description information corresponding to the interface element is determined, so that the comprehensiveness and accuracy of the corresponding text description information are improved based on the content of the plurality of control elements indicating the same message source.
Each interface element obtained after the division includes or indicates certain information, for example, one or more of commodity information, article information, schedule information, and the like, and the text description information determined in this step is used for describing information included in or corresponding to the interface element.
In step S103, the index content of each interface element is obtained.
For example, when the interface element is a character, the indexing content may also be the screenshot of the interface element (that is, the screenshot includes the picture and the character), or when the interface element is a picture and a character, the indexing content may be the screenshot of the interface element (that is, the screenshot includes the picture and the character), or the indexing content may be the screenshot of the picture and the character. In addition, if link information is included in the interface element, the indexing content includes the link information. And carrying out corresponding extraction operation according to the indexing content of the various interface elements.
In step S104, at least one corresponding note and a category of the note are generated according to the indexing content and the textual description information of each interface element.
The information contained or corresponding to the interface element, such as commodity information, article information, schedule information, etc., can be obtained from the text description information of the interface element. Therefore, the text description information can be used for determining the note type which can be generated by the interface element, and the text description information can be used for determining the note type which can be generated by the interface element in combination with the type of the application program to which the information extraction page belongs, for example, if the application program belongs to a shopping category, the note type which can be generated by the interface element comprises commodity information; the notes of that type are then generated by note type and with all or part of the indexing content. When the interface element only contains one information type, all or part of the indexing content is used for generating a note of the type, and the category is marked on the note, when the interface element contains two or more information types, all or part of the indexing content is used for generating the note of each type, and the category marked on each label is respectively corresponded, for example, when the interface element contains two types of information of commodity information and schedule information, one note is generated by using the content related to the commodity in the indexing content, the commodity category is marked on the note, then another note is generated by using the content related to the schedule in the indexing content, and the schedule category is marked on the note. The indexing content is a screenshot of a picture and/or a character, and the screenshot or the content in the screenshot is used for generating a note, for example, the screenshot comprises schedule time, and the schedule time needs to be added when generating the note of the schedule class.
According to the note generation method provided by the embodiment of the disclosure, when a note generation command of a user is received, a current page is acquired as an information extraction page, then the text description information of interface elements of the information extraction page is determined, the indexing content of each interface element is acquired, and finally notes and categories are generated according to the text description information and the indexing content. Because the user can input the note generation command under any display interface, all display pages of the terminal equipment can be identified, and the requirement of the user for acquiring information under any situation is met; in addition, the text description information and the indexing content of the interface elements are respectively obtained, and notes of at least one type can be generated for each interface element according to the text description information and the indexing content, so that the requirement of obtaining information of various types by a user is met, and the efficiency, the coverage range and the pertinence of obtaining the information by the user are integrally improved.
In some embodiments of the present disclosure, the textual description information for at least one of the interface elements is determined as follows: traversing each interface element, determining whether the interface element contains text content, and obtaining three results, namely that all the interface elements contain the text content, all the interface elements do not contain the text content, and part of the interface elements contain the text content; correspondingly executing the following steps aiming at the three results:
case where all interface elements contain textual content: the text content contained in each interface element can be identified, and the word description information of the interface element is determined according to the text content; in addition, the image content contained in each interface element can be identified, namely, the image content is subjected to image identification processing, and the text description information corresponding to the interface element is further enriched and updated according to the image content.
Case where all interface elements do not contain text content: the image content contained in each interface element can be identified, that is, the image content is subjected to image identification processing, and the text description information corresponding to each interface element is obtained according to the image content.
Case where part of the interface elements contain textual content: for interface elements containing text content, the text content contained in each interface element can be identified, and the character description information of the interface element is determined according to the text content, in addition, the image content contained in each interface element can be further identified, and the character description information corresponding to the interface element is further enriched and updated according to the image content; then, for the interface elements not containing text content, the image content contained in each interface element can be identified, that is, the image content is subjected to image identification processing, and the character description information corresponding to the interface element is obtained according to the identification result.
The text content can be recognized by adopting an Optical Character Recognition (OCR) mode and a Natural Language Processing (NLP) mode, and the interface element character description information is determined according to the recognition result; the interface elements can be subjected to image recognition by adopting an Optical Character Recognition (OCR) mode and a Natural Language Processing (NLP) mode, a neural network which can be used for image recognition and text description information extraction can be trained in advance, and then the neural network is utilized to perform image recognition on the interface elements.
In some embodiments of the present disclosure, the time when the note generation command is received may also be synchronously acquired when the note generation command is received, and after notes are generated in response to the note generation command, the acquired time may be marked in each generated note. The marked time is the note generation time, and the note information can be enriched through the marked time, so that the user can check and filter the information conveniently, and the efficiency and accuracy of the user for looking up the information are improved.
In some embodiments of the present disclosure, another note generating method is further provided, please refer to fig. 2, which shows a complete flow of the note generating method, including steps S201 to S206, where steps S201 to S204 are the same as steps S101 to S104 shown in fig. 1, and the note generating method may be regarded as adding step S205 and step S206 to the method shown in fig. 1, so that the description of steps S201 to S204 is not repeated, and the following description focuses on step S205 and step S206.
In step S205, a note screening interface is generated according to all the generated notes and the corresponding categories.
The note screening interface may be a page occupying the whole screen, that is, after receiving a note generation command, the display page of the screen may be switched to the note screening interface after generating a note and labeling a category; the note screening interface can be a floating window or a pull-down window or a slide-up window which is displayed on the screen, namely only one part of the whole screen can be occupied, after a note generating command is received, a window can be popped up on the basis of the current display page of the screen after notes are generated and categories are marked, and the display content of the window is the note screening interface. In the note screening interface, all the generated notes and the types can be sequentially displayed in a list or matrix mode, and each note is correspondingly provided with a storage button and a deletion button.
In step S206, a filtering operation based on the input of the note filtering interface is obtained, and at least one note is saved according to the filtering operation.
The selection operation is to store the notes and delete the notes, that is, when the user triggers the storage button corresponding to the notes in the note selection interface, the selection operation is to input the storage operation, and when the user triggers the deletion button corresponding to the notes in the note selection interface, the selection operation is to input the deletion operation. And saving the note corresponding to the saving operation input by the user, and deleting the note corresponding to the deleting operation input by the user.
In one example, after saving notes selected by a user, it is further determined whether the saved notes include notes of which the category is schedule, and if at least one saved note includes notes of which the category is schedule, corresponding reminding information is generated according to the notes of which the category is schedule, wherein the reminding information is used for reminding the user to pay attention to the schedule after the time related to the schedule arrives. For example, a schedule may be added to a corresponding date of the calendar, and when the date is reached, the user may be reminded of the schedule in the form of an alarm clock.
In the embodiment, by displaying the note screening interface, acquiring the operation of the user and storing the notes required by the user, the notes can be stored according to the requirement of the user, and the pertinence and the accuracy of information storage are improved. Since many different types of notes can often be generated for one interface element, the user is required to filter which types of notes are of interest and need for the user and save for subsequent use by the user.
According to a second aspect of the embodiments of the present disclosure, there is provided a note generating device applied to a mobile terminal, please refer to fig. 3, which shows a schematic structural diagram of the device, and the device includes:
the page acquisition module 301 is configured to determine an information extraction page according to the note generation command;
the interface processing module 302 is configured to obtain a plurality of interface elements of the information extraction page, and determine textual description information of each interface element;
a content obtaining module 303, configured to obtain an indexing content of each interface element;
and a note generating module 304, configured to generate at least one corresponding note and a category of the note according to the indexing content and the text description information of each interface element.
In some embodiments of the present disclosure, the information extraction page includes at least one control element;
the interface processing module is specifically configured to:
dividing the information extraction page by taking the boundary of the adjacent control elements as a dividing line to obtain at least one control element;
and taking at least one control element as an interface element.
In some embodiments of the present disclosure, the interface processing module is specifically configured to:
and identifying text content contained in the interface element, and determining the character description information of the interface element according to the text content.
In some embodiments of the present disclosure, the interface processing module is specifically configured to:
and identifying image content contained in the interface element, and determining the text description information corresponding to the interface element according to the image content.
In some embodiments of the present disclosure, the content obtaining module is specifically configured to:
acquiring a screenshot of the interface element; and/or
And acquiring the link information contained in the interface element.
In some embodiments of the present disclosure, the note generation module is specifically configured to:
determining at least one note type corresponding to the interface element according to the type of the application program to which the text description information and/or the information extraction page belongs;
generating notes of each of the at least one note type based on the indexing content.
In some embodiments of the present disclosure, the system further comprises a time marking module, configured to:
acquiring time when the note generation command is received;
and generating the generation time of each note according to the acquired time label.
In some embodiments of the present disclosure, the system further comprises a note storage module, configured to:
generating a note screening interface according to all the generated notes and the corresponding categories;
and acquiring a screening operation input based on the note screening interface, and storing at least one note according to the screening operation.
In some embodiments of the present disclosure, the system further comprises a schedule processing module configured to:
and if the at least one saved note has a note with the category of schedule, generating corresponding reminding information according to the note with the category of schedule, wherein the reminding information is used for reminding a user to pay attention to the schedule after the time related to the schedule is reached.
With regard to the apparatus in the above-mentioned embodiments, the specific manner in which each module performs the operation has been described in detail in the first aspect with respect to the embodiment of the method, and will not be elaborated here.
According to a third aspect of the embodiments of the present disclosure, please refer to fig. 4, which schematically illustrates a block diagram of an electronic device. For example, the apparatus 400 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 4, the apparatus 400 may include one or more of the following components: processing components 402, memory 404, power components 406, multimedia components 408, audio components 410, input/output (I/O) interfaces 412, sensor components 414, and communication components 416.
The processing component 402 generally controls overall operation of the apparatus 400, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 402 may include one or more processors 420 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 402 can include one or more modules that facilitate interaction between the processing component 402 and other components. For example, the processing component 402 can include a multimedia module to facilitate interaction between the multimedia component 408 and the processing component 402.
The memory 404 is configured to store various types of data to support operations at the device 400. Examples of such data include instructions for any application or method operating on the device 400, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 404 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The multimedia component 408 includes a screen that provides an output interface between the device 400 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 408 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the apparatus 400 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 410 is configured to output and/or input audio signals. For example, audio component 410 includes a Microphone (MIC) configured to receive external audio signals when apparatus 400 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 404 or transmitted via the communication component 416. In some embodiments, audio component 410 also includes a speaker for outputting audio signals.
The I/O interface 412 provides an interface between the processing component 402 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor component 414 includes one or more sensors for providing various aspects of status assessment for the apparatus 400. For example, the sensor assembly 414 may detect an open/closed state of the apparatus 400, the relative positioning of the components, such as a display and keypad of the apparatus 400, the sensor assembly 414 may also detect a change in the position of the apparatus 400 or a component of the apparatus 400, the presence or absence of user contact with the apparatus 400, orientation or acceleration/deceleration of the apparatus 400, and a change in the temperature of the apparatus 400. The sensor assembly 414 may also include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 414 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 416 is configured to facilitate wired or wireless communication between the apparatus 400 and other devices. The apparatus 400 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G or 6G or a combination thereof. In an exemplary embodiment, the communication component 416 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 400 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the power supply method of the above-described electronic devices.
In a fourth aspect, the present disclosure also provides, in an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 404 comprising instructions, executable by the processor 420 of the apparatus 400 to perform the method for powering the electronic device. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (20)
1. A note generation method is applied to a mobile terminal, and comprises the following steps:
determining an information extraction page according to the note generation command;
acquiring a plurality of interface elements of the information extraction page, and determining the text description information of each interface element;
acquiring the indexing content of each interface element;
and generating at least one corresponding note and the category of the note according to the indexing content and the text description information of each interface element.
2. The note generation method according to claim 1, wherein the information extraction page includes at least one control element;
the obtaining of the plurality of interface elements of the information extraction page includes:
dividing the information extraction page by taking the boundary of the adjacent control elements as a dividing line to obtain at least one control element;
and taking at least one control element as an interface element.
3. The note generation method of claim 1, wherein determining textual description information for each of the interface elements comprises:
and identifying text content contained in the interface element, and determining the character description information of the interface element according to the text content.
4. The note generation method according to claim 1 or 3, wherein determining the textual description information for each interface element includes:
and identifying image content contained in the interface element, and determining the text description information corresponding to the interface element according to the image content.
5. The note generation method according to claim 1, wherein the obtaining of the indexing content of each interface element includes:
acquiring a screenshot of the interface element; and/or the presence of a gas in the gas,
and acquiring the link information contained in the interface element.
6. The note generating method according to claim 1, wherein the generating of the corresponding at least one note and the category of the note according to the indexing content and the textual description information of each interface element includes:
determining at least one note type corresponding to the interface element according to the type of the application program to which the text description information and/or the information extraction page belongs;
generating notes of each of the at least one note type based on the indexing content.
7. The note generation method according to claim 1, wherein before the generating of the corresponding at least one note and the category of the note according to the indexing content and the textual description information of each interface element, the method further comprises:
acquiring time when the note generation command is received;
and marking the generation time of each note generated according to the acquired time.
8. The note generation method according to claim 1, further comprising:
generating a note screening interface according to all the generated notes and the corresponding categories;
and acquiring a screening operation input based on the note screening interface, and storing at least one note according to the screening operation.
9. The note generation method according to claim 8, further comprising:
and if the at least one saved note has a note with the category of schedule, generating corresponding reminding information according to the note with the category of schedule, wherein the reminding information is used for reminding a user to pay attention to the schedule after the time related to the schedule is reached.
10. A note generation device, applied to a mobile terminal, the device comprising:
the page acquisition module is used for determining an information extraction page according to the note generation command;
the interface processing module is used for obtaining a plurality of interface elements of the information extraction page and determining the text description information of each interface element;
the content acquisition module is used for acquiring the indexing content of each interface element;
and the note generating module is used for generating at least one corresponding note and the type of the note according to the indexing content and the character description information of each interface element.
11. The note generation apparatus according to claim 10, wherein the information extraction page includes at least one control element;
the interface processing module is specifically configured to:
dividing the information extraction page by taking the boundary of the adjacent control elements as a dividing line to obtain at least one control element;
and taking at least one control element as an interface element.
12. The note generation apparatus of claim 10, wherein the interface processing module is specifically configured to:
and identifying text content contained in the interface element, and determining the character description information of the interface element according to the text content.
13. The note generation apparatus according to claim 10 or 12, wherein the interface processing module is specifically configured to:
and identifying image content contained in the interface element, and determining the text description information corresponding to the interface element according to the image content.
14. The note generation apparatus of claim 10, wherein the content acquisition module is specifically configured to:
acquiring a screenshot of the interface element; and/or the presence of a gas in the gas,
and acquiring the link information contained in the interface element.
15. The note generation apparatus of claim 10, wherein the note generation module is specifically configured to:
determining at least one note type corresponding to the interface element according to the type of the application program to which the text description information and/or the information extraction page belongs;
generating notes of each of the at least one note type based on the indexing content.
16. The note generation apparatus of claim 10, further comprising a time marking module configured to:
acquiring time when the note generation command is received;
and generating the generation time of each note according to the acquired time label.
17. The note generation apparatus of claim 10, further comprising a note storage module configured to:
generating a note screening interface according to all the generated notes and the corresponding categories;
and acquiring a screening operation input based on the note screening interface, and storing at least one note according to the screening operation.
18. The note generation apparatus of claim 17, further comprising a schedule processing module configured to:
and if the at least one saved note has a note with the category of schedule, generating corresponding reminding information according to the note with the category of schedule, wherein the reminding information is used for reminding a user to pay attention to the schedule after the time related to the schedule is reached.
19. An electronic device, comprising a memory for storing computer instructions executable on a processor, the processor being configured to base the note generation method of any one of claims 1-9 when executing the computer instructions.
20. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, carries out the method of any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010899602.0A CN112035031B (en) | 2020-08-31 | 2020-08-31 | Note generation method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010899602.0A CN112035031B (en) | 2020-08-31 | 2020-08-31 | Note generation method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112035031A true CN112035031A (en) | 2020-12-04 |
| CN112035031B CN112035031B (en) | 2022-03-11 |
Family
ID=73587755
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010899602.0A Active CN112035031B (en) | 2020-08-31 | 2020-08-31 | Note generation method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112035031B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113157187A (en) * | 2021-05-20 | 2021-07-23 | 读书郎教育科技有限公司 | Method for realizing general note by Android terminal, computer storage medium and Android terminal |
| CN114463730A (en) * | 2021-07-15 | 2022-05-10 | 荣耀终端有限公司 | Page identification method and terminal equipment |
| CN116069219A (en) * | 2022-06-23 | 2023-05-05 | 荣耀终端有限公司 | Method for acquiring schedule information and electronic equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102647526A (en) * | 2012-04-28 | 2012-08-22 | 青岛海信移动通信技术股份有限公司 | Mobile phone notepad classification processing method, processing unit and mobile phone |
| CN104866182A (en) * | 2015-02-16 | 2015-08-26 | 锤子软件（北京）有限公司 | Movement method of picture data and mobile terminal |
| CN106293705A (en) * | 2016-07-27 | 2017-01-04 | 维沃移动通信有限公司 | A kind of collecting method and mobile terminal |
| CN106791055A (en) * | 2016-12-08 | 2017-05-31 | 宇龙计算机通信科技(深圳)有限公司 | A kind of method for generating memorandum record, device and mobile terminal |
| CN107291931A (en) * | 2017-06-30 | 2017-10-24 | 珠海格力电器股份有限公司 | Note generation method and device and user terminal |
| CN107943397A (en) * | 2017-11-27 | 2018-04-20 | 努比亚技术有限公司 | A kind of note generation method, mobile terminal and computer-readable recording medium |
| CN109117281A (en) * | 2018-07-09 | 2019-01-01 | 维沃移动通信有限公司 | Note generation method and terminal |
| CN109165320A (en) * | 2018-06-27 | 2019-01-08 | 维沃移动通信有限公司 | A kind of information collection method and mobile terminal |
| US20190026313A1 (en) * | 2016-01-28 | 2019-01-24 | Alibaba Group Holding Limited | Device, method, and user interface for managing and interacting with media content |
-
2020
- 2020-08-31 CN CN202010899602.0A patent/CN112035031B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102647526A (en) * | 2012-04-28 | 2012-08-22 | 青岛海信移动通信技术股份有限公司 | Mobile phone notepad classification processing method, processing unit and mobile phone |
| CN104866182A (en) * | 2015-02-16 | 2015-08-26 | 锤子软件（北京）有限公司 | Movement method of picture data and mobile terminal |
| US20190026313A1 (en) * | 2016-01-28 | 2019-01-24 | Alibaba Group Holding Limited | Device, method, and user interface for managing and interacting with media content |
| CN106293705A (en) * | 2016-07-27 | 2017-01-04 | 维沃移动通信有限公司 | A kind of collecting method and mobile terminal |
| CN106791055A (en) * | 2016-12-08 | 2017-05-31 | 宇龙计算机通信科技(深圳)有限公司 | A kind of method for generating memorandum record, device and mobile terminal |
| CN107291931A (en) * | 2017-06-30 | 2017-10-24 | 珠海格力电器股份有限公司 | Note generation method and device and user terminal |
| CN107943397A (en) * | 2017-11-27 | 2018-04-20 | 努比亚技术有限公司 | A kind of note generation method, mobile terminal and computer-readable recording medium |
| CN109165320A (en) * | 2018-06-27 | 2019-01-08 | 维沃移动通信有限公司 | A kind of information collection method and mobile terminal |
| CN109117281A (en) * | 2018-07-09 | 2019-01-01 | 维沃移动通信有限公司 | Note generation method and terminal |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113157187A (en) * | 2021-05-20 | 2021-07-23 | 读书郎教育科技有限公司 | Method for realizing general note by Android terminal, computer storage medium and Android terminal |
| CN113157187B (en) * | 2021-05-20 | 2022-03-29 | 读书郎教育科技有限公司 | Method for realizing general note by Android terminal, computer storage medium and Android terminal |
| CN114463730A (en) * | 2021-07-15 | 2022-05-10 | 荣耀终端有限公司 | Page identification method and terminal equipment |
| CN114463730B (en) * | 2021-07-15 | 2023-07-14 | 荣耀终端有限公司 | Page identification method and terminal equipment |
| CN116069219A (en) * | 2022-06-23 | 2023-05-05 | 荣耀终端有限公司 | Method for acquiring schedule information and electronic equipment |
| CN116069219B (en) * | 2022-06-23 | 2024-04-02 | 荣耀终端有限公司 | Method for acquiring schedule information and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112035031B (en) | 2022-03-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112035031B (en) | Note generation method and device, electronic equipment and storage medium | |
| CN109039857B (en) | Method for providing message function and electronic device thereof | |
| EP3239836B1 (en) | Information displaying method and apparatus, computer program and recording medium | |
| US8963983B2 (en) | Mobile terminal and method of controlling the same | |
| CN105068976B (en) | Ticket information display method and device | |
| US9959487B2 (en) | Method and device for adding font | |
| KR102053196B1 (en) | Mobile terminal and control method thereof | |
| KR20110037247A (en) | Mobile terminal and method for transmitting contents thereof | |
| CN111897475A (en) | Message viewing method and device | |
| CN110989902A (en) | Information processing method and device, writing equipment and terminal equipment | |
| CN109799916B (en) | Candidate item association method and device | |
| WO2023134599A1 (en) | Voice information sending method and apparatus, and electronic device | |
| CN109145151B (en) | Video emotion classification acquisition method and device | |
| CN107885571B (en) | Display page control method and device | |
| CN106412199B (en) | Method and device for editing contact information, mobile terminal and server | |
| CN108108356B (en) | Character translation method, device and equipment | |
| CN111489131A (en) | Information recommendation method and device | |
| CN110362760B (en) | Method, device and medium for intelligently prompting search results | |
| CN109388328B (en) | Input method, device and medium | |
| CN110929484A (en) | Text processing method, device and storage medium | |
| CN110598489A (en) | Privacy protection method for inputting prompt information and related device | |
| CN109408623B (en) | Information processing method and device | |
| CN114154465B (en) | Structure reconstruction method and device of structure diagram, electronic equipment and storage medium | |
| CN111880697B (en) | Encyclopedic data processing method and device | |
| CN113220392A (en) | Interface display method and device and interface display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |