CN111898595A - Information display method and device, electronic equipment and storage medium - Google Patents
Information display method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111898595A CN111898595A CN202010714114.8A CN202010714114A CN111898595A CN 111898595 A CN111898595 A CN 111898595A CN 202010714114 A CN202010714114 A CN 202010714114A CN 111898595 A CN111898595 A CN 111898595A
- Authority
- CN
- China
- Prior art keywords
- information
- finger
- extended
- determining
- search result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
- G06V10/235—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition based on user input or interaction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F15/00—Digital computers in general; Data processing equipment in general
- G06F15/02—Digital computers in general; Data processing equipment in general manually operated with input through keyboard and computation using a built-in program, e.g. pocket calculators
- G06F15/0225—User interface arrangements, e.g. keyboard, display; Interfaces to other computer systems
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Multimedia (AREA)
- Educational Technology (AREA)
- Educational Administration (AREA)
- Business, Economics & Management (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the disclosure discloses an information display method, an information display device, information display equipment and a storage medium, wherein the method comprises the following steps: responding to an information display request, acquiring image information through a camera assembly, and determining the position of a finger in the image information; determining a pointing region of the finger according to the finger position, and extracting text information in the pointing region; and acquiring matched extended information according to the character information, and displaying the extended information through a display screen. According to the technical scheme of the embodiment, the finger position and the pointing area in the image information shot by the camera shooting assembly are determined, and after the character information is extracted from the pointing area, the related extension information is displayed through the display screen, the reading content is enriched, the defect that the extension knowledge cannot be acquired in real time in paper books is overcome, the information acquisition efficiency is improved, meanwhile, the camera shooting assembly shoots the finger position, the traditional single reading mode is changed, and the reading interest is improved.
Description
Technical Field
The embodiment of the disclosure relates to an image recognition technology, and in particular, to an information display method and apparatus, an electronic device, and a storage medium.
Background
The paper books have the characteristics of easy note taking, convenient page turning, book fragrance diffusion and the like, and are more eye-protecting compared with electronic books, so that the paper books still occupy an important position in learning and life nowadays.
For students, particularly students in middle and primary schools, most textbooks used and books outside the class read are still made of paper, but pictures and characters in the paper books are static, the reading mode is too single, interestingness is not enough, meanwhile, the paper books only comprise contents recorded in the paper, the contents are not rich enough, explanation and expansion of knowledge are not enough, and information acquisition efficiency is low.
Disclosure of Invention
The disclosure provides an information display method, an information display device, information display equipment and a storage medium, so that extended information matched with reading information of a user in a paper book can be displayed through a display screen.
In a first aspect, an embodiment of the present disclosure provides an information display method, including:
responding to an information display request, acquiring image information through a camera assembly, and determining the position of a finger in the image information;
determining a pointing region of the finger according to the finger position, and extracting text information in the pointing region;
and acquiring matched extended information according to the character information, and displaying the extended information through a display screen.
In a second aspect, an embodiment of the present disclosure provides an information display apparatus, including:
the finger position determining module is used for responding to the information display request, acquiring image information through the camera shooting assembly and determining the position of a finger in the image information;
the character information acquisition module is used for determining a pointing area of the finger according to the position of the finger and extracting character information from the pointing area;
and the extended information display module is used for acquiring matched extended information according to the text information and displaying the extended information through a display screen.
In a third aspect, an embodiment of the present disclosure provides an electronic device, which includes a memory, a processing apparatus, and a computer program that is stored in the memory and is executable on the processing apparatus, where the processing apparatus implements an information displaying method according to any embodiment of the present disclosure when executing the program.
In a fourth aspect, embodiments of the present disclosure provide a storage medium containing computer-executable instructions for performing the information presentation method of any of the embodiments of the present disclosure when executed by a computer processor.
According to the technical scheme, the finger position and the pointing area in the image information shot by the camera shooting assembly are determined in response to the information display request, after the character information is extracted from the pointing area, the related extended information is displayed through the display screen, the reading content is enriched, the defect that extended knowledge cannot be obtained in a paper book in real time is overcome, the information obtaining efficiency is improved, meanwhile, the camera shooting assembly shoots the finger position, the traditional single reading mode is changed, and the reading interestingness is improved.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale.
Fig. 1 is a flowchart of an information presentation method in a first embodiment of the present disclosure;
fig. 2 is a block diagram of an information display apparatus according to a second embodiment of the disclosure;
fig. 3 is a block diagram of an electronic device in a third embodiment of the disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
Example one
Fig. 1 is a flowchart of an information displaying method provided in an embodiment of the present disclosure, where this embodiment is applicable to displaying, on a display screen, extended information that matches reading information of a user in a paper book, and the method may be executed by an information displaying apparatus in an embodiment of the present disclosure, where the apparatus may be implemented by software and/or hardware and is integrated in a terminal device having a camera assembly and a display screen, and the method specifically includes the following steps:
and S110, responding to the information display request, acquiring image information through the camera assembly, and determining the position of the finger in the image information.
The information display request may be triggered by a set physical key or a virtual key on the display screen, or may be triggered by a recognized specific voice instruction. The camera shooting assembly is positioned right above or obliquely above the user and shoots downwards, so that the position of the finger can be accurately detected in the shot image information, and the finger is prevented from being shielded; and determining the position of the finger in the acquired image information through a computer vision technology.
And S120, determining a pointing area of the finger according to the position of the finger, and extracting text information in the pointing area.
The user points at the picture and/or text information in paper materials such as books, newspapers and the like through fingers, so that the pointed area of the fingers is also the target area to be identified; the text information extracted from the target area reflects the specific content that the user wants to know.
Optionally, in this embodiment of the present disclosure, the extracting text information in the pointing region includes: and identifying pictures and/or texts in the pointing area by an optical character recognition technology so as to extract literal information. An Optical Character Recognition (OCR) technology is a process of determining the shape of a Character by detecting dark and light patterns, and then translating the shape into a computer text by a Character Recognition method; specifically, for the print characters, the characters (including the characters in the picture and the characters in the text) in the paper document are converted into the image file of the black-and-white dot matrix in an optical mode, and then the black-and-white dot matrix in the image is converted into the character information in the text format.
S130, acquiring matched extended information according to the character information, and displaying the extended information through a display screen.
The extension information may be data information stored locally, for example, an electronic dictionary downloaded by a user in advance, and when the text information pointed by the user is acquired, the electronic dictionary is searched for a relevant text explanation; the extended information may also be a video and a book that are downloaded in advance by the user, and when the text information pointed by the user is obtained, the matched video or book is searched.
Optionally, in this embodiment of the present disclosure, the obtaining matched extended information according to the text information includes: and carrying out cloud search according to the text information, and taking a search result as extended information. The search result is usually a web page containing a plurality of search result items, but the information that the user wants to obtain is usually exact information related to the text information, for example, the text information is a word "bright", and for the user, especially a student, the user wants to obtain specific information such as word pronunciation, explanation and departure of "bright", so that in order to facilitate the user to obtain the related information in time and avoid a cumbersome process of secondary selection, the web page content corresponding to the optimal search result item (i.e. the first search result item after filtering the advertisement content) in the search result can be displayed as the expanded information in front of the user.
Optionally, in this embodiment of the present disclosure, the performing cloud search according to the text information, and using the search result as extended information includes: and performing cloud search according to the text information and the voice information, and taking a search result as extended information. The text information sometimes cannot accurately reflect the real intention of the user, and in the above technical solution, for example, the text information is the word "bright", but the user wants to acquire the synonym or the antisense word of "bright", only the "bright" is searched, and the search result cannot reflect the required content, so that the real intention of the user can be more accurately reflected through the text information pointed by the finger and the voice information acquired through the microphone, for example, the text information is "bright", the voice information is "antisense word", and the acquired search result is the antisense word such as "dim", or "dim". Specifically, the voice information is synchronous voice information obtained when the finger points to the text information. In order to ensure the consistency of the text information and the voice information on the time sequence, the acquired voice information is the voice information acquired at the same time when the finger points to the character information.
Optionally, in this embodiment of the present disclosure, after taking the search result as the extended information, the method further includes: and determining matched recommendation information according to the search result, and adding the recommendation information into a recommendation system. The recommendation information can be specific types of recommendation information, such as teaching videos, for example, in the above technical solution, the recommendation information is a teaching video related to text information "bright" and is added to the recommendation system, and the user can choose to better understand the word "bright" by watching the related teaching video; the recommendation information may also be other search result items than the optimal search result item in the search results, and in the embodiment of the present disclosure, the type of the recommendation information is not particularly limited.
Optionally, in this embodiment of the present disclosure, after taking the search result as the extended information, the method further includes: and adding the search result into a paper book reading record of the user, and determining the interest point of the user by combining the electronic book reading record of the user. The electronic book reading record of the user can be derived from the playing record of the display screen in the disclosure, and can also be derived from the reading record in a mobile phone or other terminal equipment; the search result of the user reflects the reading interest of the user in the paper book, so that the interest point of the user is more accurately acquired by combining the reading record of the electronic book and the reading record of the paper book, and the method is favorable for pertinently sending interested recommended content to the user.
According to the technical scheme, the finger position and the pointing area in the image information shot by the camera shooting assembly are determined in response to the information display request, after the character information is extracted from the pointing area, the related extended information is displayed through the display screen, the reading content is enriched, the defect that extended knowledge cannot be obtained in a paper book in real time is overcome, the information obtaining efficiency is improved, meanwhile, the camera shooting assembly shoots the finger position, the traditional single reading mode is changed, and the reading interestingness is improved.
Example two
Fig. 2 is a block diagram of an information display apparatus provided in the second embodiment of the present disclosure, which specifically includes: a finger position determination module 210, a text information acquisition module 220, and an extended information presentation module 230.
The finger position determining module 210 is configured to, in response to an information display request, acquire image information through a camera component, and determine a finger position in the image information;
the text information acquisition module 220 is configured to determine a pointing region of the finger according to the position of the finger, and extract text information from the pointing region;
and the extended information display module 230 is configured to obtain the matched extended information according to the text information, and display the extended information through a display screen.
According to the technical scheme, the finger position and the pointing area in the image information shot by the camera shooting assembly are determined in response to the information display request, after the character information is extracted from the pointing area, the related extended information is displayed through the display screen, the reading content is enriched, the defect that extended knowledge cannot be obtained in a paper book in real time is overcome, the information obtaining efficiency is improved, meanwhile, the camera shooting assembly shoots the finger position, the traditional single reading mode is changed, and the reading interestingness is improved.
Optionally, on the basis of the above technical solution, the text information obtaining module 220 is specifically configured to identify, through an optical character recognition technology, the picture and/or the text in the pointing region to extract the text information.
Optionally, on the basis of the above technical solution, the extended information display module 230 is specifically configured to perform cloud search according to the text information, and use a search result as extended information.
Optionally, on the basis of the above technical solution, the extended information display module 230 is further specifically configured to perform cloud search according to the text information and the voice information, and use a search result as extended information.
Optionally, on the basis of the above technical solution, the voice information is synchronous voice information obtained when the finger points to the text information.
Optionally, on the basis of the above technical solution, the information display apparatus further includes:
and the recommendation information acquisition module is used for determining matched recommendation information according to the search result and adding the recommendation information into a recommendation system.
Optionally, on the basis of the above technical solution, the information display apparatus further includes:
and the interest point determining module is used for adding the search result into a paper book reading record of the user and determining the interest point of the user by combining the electronic book reading record of the user.
The device can execute the information display method provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method. Technical details that are not elaborated in this embodiment may be referred to a method provided by any embodiment of the present disclosure.
EXAMPLE III
FIG. 3 illustrates a schematic diagram of an electronic device 300 suitable for use in implementing embodiments of the present disclosure. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 3 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 3, the electronic device 300 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 301 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)302 or a program loaded from a storage means 308 into a Random Access Memory (RAM) 303. In the RAM 303, various programs and data necessary for the operation of the electronic apparatus 300 are also stored. The processing device 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.
Generally, the following devices may be connected to the I/O interface 305: input devices 306 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 307 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage devices 308 including, for example, magnetic tape, hard disk, etc.; and a communication device 309. The communication means 309 may allow the electronic device 300 to communicate wirelessly or by wire with other devices to exchange data. While fig. 3 illustrates an electronic device 300 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication means 309, or installed from the storage means 308, or installed from the ROM 302. The computer program, when executed by the processing device 301, performs the above-described functions defined in the methods of the embodiments of the present disclosure.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText transfer protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: responding to an information display request, acquiring image information through a camera assembly, and determining the position of a finger in the image information; determining a pointing region of the finger according to the finger position, and extracting text information in the pointing region; and acquiring matched extended information according to the character information, and displaying the extended information through a display screen.
Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules described in the embodiments of the present disclosure may be implemented by software or hardware. The name of the module does not in some cases form a limitation on the module itself, for example, the recommendation information obtaining module may be described as "a module for determining matching recommendation information according to the search result and adding the recommendation information to the recommendation system". The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, [ example 1 ] there is provided an information presentation method comprising:
responding to an information display request, acquiring image information through a camera assembly, and determining the position of a finger in the image information;
determining a pointing region of the finger according to the finger position, and extracting text information in the pointing region;
and acquiring matched extended information according to the character information, and displaying the extended information through a display screen.
In accordance with one or more embodiments of the present disclosure, [ example 2 ] there is provided the method of example 1, further comprising:
and identifying pictures and/or texts in the pointing area by an optical character recognition technology so as to extract literal information.
In accordance with one or more embodiments of the present disclosure, [ example 3 ] there is provided the method of example 1, further comprising:
and carrying out cloud search according to the text information, and taking a search result as extended information.
According to one or more embodiments of the present disclosure, [ example 4 ] there is provided the method of example 3, further comprising:
and performing cloud search according to the text information and the voice information, and taking a search result as extended information.
In accordance with one or more embodiments of the present disclosure, [ example 5 ] there is provided the method of example 4, further comprising:
and the voice information is synchronous voice information acquired when the finger points to the text information.
According to one or more embodiments of the present disclosure, [ example 6 ] there is provided the method of any one of examples 3-5, further comprising:
and determining matched recommendation information according to the search result, and adding the recommendation information into a recommendation system.
According to one or more embodiments of the present disclosure, [ example 7 ] there is provided the method of any one of examples 3-5, further comprising:
and adding the search result into a paper book reading record of the user, and determining the interest point of the user by combining the electronic book reading record of the user.
According to one or more embodiments of the present disclosure, [ example 8 ] there is provided an information presentation apparatus comprising:
the finger position determining module is used for responding to the information display request, acquiring image information through the camera shooting assembly and determining the position of a finger in the image information;
the character information acquisition module is used for determining a pointing area of the finger according to the position of the finger and extracting character information from the pointing area;
and the extended information display module is used for acquiring matched extended information according to the text information and displaying the extended information through a display screen.
According to one or more embodiments of the present disclosure, [ example 9 ] there is provided an electronic device comprising a memory, a processing means, and a computer program stored on the memory and executable on the processing means, the processing means implementing the information presentation method as described in any of examples 1-7 when the program is executed.
According to one or more embodiments of the present disclosure, [ example 10 ] there is provided a storage medium containing computer-executable instructions for performing the information presentation method as in any one of examples 1-7 when executed by a computer processor.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims (10)
1. An information display method, comprising:
responding to an information display request, acquiring image information through a camera assembly, and determining the position of a finger in the image information;
determining a pointing region of the finger according to the finger position, and extracting text information in the pointing region;
and acquiring matched extended information according to the character information, and displaying the extended information through a display screen.
2. The method of claim 1, wherein extracting textual information in the pointing region comprises:
and identifying pictures and/or texts in the pointing area by an optical character recognition technology so as to extract literal information.
3. The method of claim 1, wherein the obtaining the matched extended information according to the text information comprises:
and carrying out cloud search according to the text information, and taking a search result as extended information.
4. The method of claim 3, wherein the cloud searching according to the text information and using the search result as the expansion information comprises:
and performing cloud search according to the text information and the voice information, and taking a search result as extended information.
5. The method according to claim 4, wherein the voice message is a synchronous voice message obtained when the finger points to the text message.
6. The method according to any one of claims 3-5, further comprising, after taking the search result as the extended information:
and determining matched recommendation information according to the search result, and adding the recommendation information into a recommendation system.
7. The method according to any one of claims 3-5, further comprising, after taking the search result as the extended information:
and adding the search result into a paper book reading record of the user, and determining the interest point of the user by combining the electronic book reading record of the user.
8. An information presentation device, comprising:
the finger position determining module is used for responding to the information display request, acquiring image information through the camera shooting assembly and determining the position of a finger in the image information;
the character information acquisition module is used for determining a pointing area of the finger according to the position of the finger and extracting character information from the pointing area;
and the extended information display module is used for acquiring matched extended information according to the text information and displaying the extended information through a display screen.
9. An electronic device comprising a memory, a processing means and a computer program stored on the memory and executable on the processing means, characterized in that the processing means, when executing the program, implements the information presentation method as claimed in any one of claims 1 to 7.
10. A storage medium containing computer-executable instructions for performing the information presentation method of any one of claims 1-7 when executed by a computer processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010714114.8A CN111898595A (en) | 2020-07-22 | 2020-07-22 | Information display method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010714114.8A CN111898595A (en) | 2020-07-22 | 2020-07-22 | Information display method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111898595A true CN111898595A (en) | 2020-11-06 |
Family
ID=73190753
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010714114.8A Pending CN111898595A (en) | 2020-07-22 | 2020-07-22 | Information display method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111898595A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112927570A (en) * | 2021-02-23 | 2021-06-08 | 京东方科技集团股份有限公司 | Interaction method, interaction device, computer equipment and computer-readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013196599A (en) * | 2012-03-22 | 2013-09-30 | Sharp Corp | Information display terminal with touch user interface, method for controlling information display terminal, and program for controlling information display terminal |
| CN104253904A (en) * | 2014-09-04 | 2014-12-31 | 广东小天才科技有限公司 | Method and smartphone for implementing reading learning |
| CN104268508A (en) * | 2014-09-15 | 2015-01-07 | 济南大学 | Portable traffic light distinguishing method for color blindness and color amblyopia people |
| CN109725732A (en) * | 2019-01-23 | 2019-05-07 | 广东小天才科技有限公司 | A kind of querying method and private tutor's equipment of knowledge point |
| CN111027537A (en) * | 2019-05-05 | 2020-04-17 | 广东小天才科技有限公司 | Question searching method and electronic equipment |
-
2020
- 2020-07-22 CN CN202010714114.8A patent/CN111898595A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013196599A (en) * | 2012-03-22 | 2013-09-30 | Sharp Corp | Information display terminal with touch user interface, method for controlling information display terminal, and program for controlling information display terminal |
| CN104253904A (en) * | 2014-09-04 | 2014-12-31 | 广东小天才科技有限公司 | Method and smartphone for implementing reading learning |
| CN104268508A (en) * | 2014-09-15 | 2015-01-07 | 济南大学 | Portable traffic light distinguishing method for color blindness and color amblyopia people |
| CN109725732A (en) * | 2019-01-23 | 2019-05-07 | 广东小天才科技有限公司 | A kind of querying method and private tutor's equipment of knowledge point |
| CN111027537A (en) * | 2019-05-05 | 2020-04-17 | 广东小天才科技有限公司 | Question searching method and electronic equipment |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112927570A (en) * | 2021-02-23 | 2021-06-08 | 京东方科技集团股份有限公司 | Interaction method, interaction device, computer equipment and computer-readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110969012B (en) | Text error correction method and device, storage medium and electronic equipment | |
| CN111445902B (en) | Data collection method, device, storage medium and electronic equipment | |
| CN111970577A (en) | Subtitle editing method and device and electronic equipment | |
| US20230229382A1 (en) | Method and apparatus for synchronizing audio and text, readable medium, and electronic device | |
| CN111178056A (en) | Deep learning based file generation method and device and electronic equipment | |
| CN113204691B (en) | Information display method, device, equipment and medium | |
| CN112287206A (en) | Information processing method and device and electronic equipment | |
| CN110019906B (en) | Method and apparatus for displaying information | |
| CN113515686A (en) | Content search method, device, equipment and storage medium | |
| CN113778285A (en) | Prop processing method, device, equipment and medium | |
| CN114445754A (en) | Video processing method and device, readable medium and electronic equipment | |
| CN111327960B (en) | Article processing method and device, electronic equipment and computer storage medium | |
| CN113407665A (en) | Text comparison method, device, medium and electronic equipment | |
| CN112307246A (en) | Learning group acquisition method, device, server and storage medium | |
| CN111898595A (en) | Information display method and device, electronic equipment and storage medium | |
| CN111767259A (en) | Content sharing method and device, readable medium and electronic equipment | |
| CN112309389A (en) | Information interaction method and device | |
| CN111260445A (en) | House resource information display method, device, terminal and storage medium | |
| CN112084441A (en) | Information retrieval method and device and electronic equipment | |
| CN115171122A (en) | Point reading processing method, device, equipment and medium | |
| CN114239501A (en) | Contract generation method, apparatus, device and medium | |
| CN113486212A (en) | Search recommendation information generation and display method, device, equipment and storage medium | |
| CN112905838A (en) | Information retrieval method and device, storage medium and electronic equipment | |
| CN112307245B (en) | Method and apparatus for processing image | |
| CN112307717A (en) | Text labeling information display method and device, electronic equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201106 |