CN105204752B - Projection realizes interactive method and system in reading - Google Patents
Projection realizes interactive method and system in reading Download PDFInfo
- Publication number
- CN105204752B CN105204752B CN201410244485.9A CN201410244485A CN105204752B CN 105204752 B CN105204752 B CN 105204752B CN 201410244485 A CN201410244485 A CN 201410244485A CN 105204752 B CN105204752 B CN 105204752B
- Authority
- CN
- China
- Prior art keywords
- page
- content
- projection
- pages
- book
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
Interactive method and system is realized in being read the present invention provides a kind of projection.The method includes：E-book or paper book are projected to obtain projecting the page accordingly；The movement of infrared pen, obtains mobile trace of the infrared pen on content of pages in the projection page in the infrared positioning projection page；It is redrawn according to the mobile trace of the infrared pen to generate the corresponding notes of the content of pages, and the notes are preserved into corresponding catalogue.The system comprises projection module, mobile position-fixed module and redraw module.The projection of hard-copies and the projection of e-book can be compatible with using the present invention, subsequent operation is carried out with the content to hard-copies projection and e-book projection.
Description
Technical field
The present invention relates to interactive application technologies, realize interactive method in being read more particularly to a kind of projection and are
System.
Background technology
During carrying out projection reading, often the content read will be needed to be projected by projecting apparatus, with
Everybody can easily be read by projecting the page.Wherein, the device for realizing projection reading includes
Newspaper reading device and portable electronic book reading device are realized that the content of the papery space of a whole page projects by newspaper reading device, are led to
Portable electronic book reading device is crossed by the content in e-book to outer projection.
However, during realizing that the more people of reading content share by way of being read projection, each realization projection
The device that formula is read can not be compatible with the projection of the projection and e-book of hard-copies, and then also can not be in the throwing to hard-copies
The content of the projection of shadow and e-book carries out subsequent operation, is confined to single function, cannot be satisfied the reading requirement of user.
Invention content
Based on this, it is necessary to a kind of projection of the projection and e-book of the compatible hard-copies of energy is provided, with to hard-copies
The projection of the content progress subsequent operation of projection and e-book projection realizes interactive method in reading.
In addition, there is a need to the projection for providing a kind of projection and e-book of the compatible hard-copies of energy, with to hard-copies
The projection of the content progress subsequent operation of projection and e-book projection realizes interactive system in reading.
A kind of projection realizes interactive method in reading, and includes the following steps：
E-book or paper book are projected to obtain projecting the page accordingly；
The movement of infrared pen in the infrared positioning projection page obtains in the projection page infrared pen in content of pages
On mobile trace；
It is redrawn according to the mobile trace of the infrared pen to generate the corresponding notes of the content of pages, and will be described
Notes are preserved into corresponding catalogue.
The mobile trace according to the infrared pen is redrawn to generate the page in one of the embodiments,
The corresponding notes of content, and the notes are preserved to the step in corresponding catalogue, the method further includes：
It triggers and the content of pages currently shown in the projection page is obtained to the projection page progress page turning；
The notes preserved are extracted from catalogue according to the content of pages currently shown；
The notes and content of pages are merged, and the notes being merged and content of pages are shown in the projection page
In.
The projection page is projected to obtain by e-book in one of the embodiments, and the triggering is to the throwing
The shadow page carry out page turning obtain it is described projection the page in currently show content of pages the step of include：
User gesture is captured, to be obtained currently to the content of pages institute in the projection page into line trace to the user gesture
The gesture of triggering；
The gesture is identified, to obtain triggering the gesture for carrying out page turning to content of pages；
The gesture for carrying out page turning with the triggering content of pages executes corresponding page turning action to obtain in the projection page
Content of pages after page turning, and be shown in the projection page.
The content of pages in the projection page is projected to the cover of paper book in one of the embodiments,
Cover image, the method further include：
Finger image is carried out to the cover image to analyze to obtain corresponding book information；
It is scanned for obtaining the relevant information of the paper book according to the book information, and projected to the projection page
Face.
In one of the embodiments, described the step of e-book being projected to obtain projecting the page accordingly it
Afterwards, the method further includes：
The word to be checked of content of pages in the projection page is obtained according to position of the infrared pen in content of pages；
It is scanned for obtaining corresponding query result according to the word to be checked, and projected to the projection page.
It is described in one of the embodiments, that cover image progress finger image is analyzed to obtain corresponding books letter
After the step of breath, the method further includes：
The click triggered in the content of pages by the infrared pen obtains containing in the projection page to be checked
Ask the selection area of word；
The e-book being consistent with the book information is judged whether, if it has, then extracting to obtain by the e-book
The word to be checked that the selection area is included, if it has not, then
Word refinement is carried out to the content of pages in the projection page, and is obtained according to position of the infrared pen in content of pages
Word to be checked；
It is scanned for obtaining corresponding query result according to the word to be checked, and projected to the projection page.
A kind of projection realizes interactive system in reading, including：
Projection module, for being projected to e-book or paper book to obtain projecting the page accordingly；
Mobile position-fixed module obtains the projection page for the movement of infrared pen in the infrared positioning projection page
In mobile trace of the infrared pen on content of pages；
Module is redrawn, it is corresponding to generate the content of pages for being redrawn according to the mobile trace of the infrared pen
Notes, and the notes are preserved into corresponding catalogue.
In one of the embodiments, the system also includes：
Page processing module obtains currently showing in the projection page for triggering to projection page progress page turning
Content of pages；
Extraction module is taken down notes, for extracting the notes preserved from catalogue according to the content of pages currently shown；
Fusion Module is shown for merging the notes and content of pages, and by the notes being merged and content of pages
It is shown in the projection page.
The projection page is projected to obtain by e-book in one of the embodiments, the page processing module
Including：
Gesture capturing unit, for capturing user gesture, to be obtained currently to projection into line trace to the user gesture
The gesture that content of pages in the page is triggered；
Recognition unit, the gesture for identification, to obtain triggering the gesture for carrying out page turning to content of pages；
Page turning execution unit, the gesture for carrying out page turning with the triggering content of pages are corresponding in projection page execution
Page turning act to obtain the content of pages after page turning, and be shown in projection the page in.
The content of pages in the projection page is projected to the cover of paper book in one of the embodiments,
Cover image, the system also includes：
Finger image analysis module is analyzed to obtain corresponding books letter for carrying out finger image to the cover image
Breath；
Books search module obtains the relevant information of the paper book for being scanned for according to the book information, and
It projects to the projection page.
In one of the embodiments, the system also includes：
Word locating module, for being obtained in the projection page in the page according to position of the infrared pen in content of pages
The word to be checked held；
First word search module obtains corresponding query result for being scanned for according to the word to be checked, and
It projects to the projection page.
In one of the embodiments, the system also includes：
Region acquisition module, the click for being triggered in the content of pages by the infrared pen obtain the projection
The selection area of word to be checked is contained in the page；
Judgment module, the e-book for judging whether to be consistent with the book information, if it has, then notice word
Extraction module, if it has not, word is then notified to refine module；
The word extraction module is used to extract to obtain the list to be checked that the selection area is included by the e-book
Word；
The word refines module and is used to carry out word refinement to the content of pages in the projection page, and is existed according to infrared pen
Position in content of pages obtains word to be checked；
Second word search module obtains corresponding query result for being scanned for according to the word to be checked, and
It projects to the projection page.
Above-mentioned projection realizes interactive method and system in reading, and will project e-book or paper book to obtain
The corresponding projection page, with the mobile infrared positioning of carry out of infrared pen in the projection page, to obtain infrared pen in the projection page
Mobile trace on content of pages is redrawn to obtain in the Current projection page according to mobile trace corresponding to content of pages
Notes, and preserve into corresponding catalogue, so that the projection realized reads projection and the electricity for being compatible with hard-copies
The projection of the philosophical works, and also can improve projection to content of pages by the arbitrary mobile subsequent operation of realization of infrared pen
The interactivity of reading.
Description of the drawings
Fig. 1 is that projection realizes interactive method flow diagram in reading in one embodiment；
Fig. 2 is that projection realizes interactive method flow diagram in reading in another embodiment；
Fig. 3 is that triggering carries out the side that page turning obtains projecting the content of pages currently shown in the page to the projection page in Fig. 2
Method flow chart；
Fig. 4 is that projection realizes interactive method flow diagram in reading in another embodiment；
Fig. 5 is that projection realizes interactive method flow diagram in reading in another embodiment；
Fig. 6 is that projection realizes interactive method flow diagram in reading in another embodiment；
Fig. 7 is that projection realizes interactive system structure diagram in reading in one embodiment；
Fig. 8 is that projection realizes interactive system structure diagram in reading in another embodiment；
Fig. 9 is the system structure diagram of page processing module in Fig. 8；
Figure 10 is that projection realizes interactive system structure diagram in reading in another embodiment；
Figure 11 is that projection realizes interactive system structure diagram in reading in another embodiment；
Figure 12 is that projection realizes interactive system structure diagram in reading in another embodiment.
Specific implementation mode
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
In one embodiment, as shown in Figure 1, a kind of projection realizes interactive method in reading, include the following steps：
Step 110, e-book or paper book are projected to obtain projecting the page accordingly.
In the present embodiment, e-book is stored in any terminal equipment existing in digital form, and paper book is then
It is existing in paper form.The projection page is the region that projector projects go out, and in a preferred embodiment, which is rectangle region
Domain.
According to the needs that Current projection formula is read, e-book or paper book can be projected, to be projected accordingly
The page is shown in the content in e-book or paper book as content of pages in the projection page, and then between the more people of realization
Reading is shared.
Step 130, in infrared positioning projection's page infrared pen movement, obtain projection the page in infrared pen in content of pages
On mobile trace.
In the present embodiment, infrared pen by for realizing user and projection the page between interactive operation, to realize projection
The random manipulation read.Specifically, by the infrared ray that infrared pen is sent out is recorded by infrared camera, record projects in the page
The infrared pen movement occurred is completed with obtaining mobile trace of the infrared pen on content of pages in the projection page to infrared pen
Mobile carried out infrared positioning.
For example, during carrying out projection reading by projecting the content of pages shown by the page, if desired emphasis
Mark certain passage, then the controllable infrared pen of user moves on this section of word, at this point, mobile infrared pen sent out it is red
Outside line has corresponded to this section of literal mobile trace.
Step 150, it is redrawn according to the mobile trace of infrared pen to generate the corresponding notes of content of pages, and will notes
It preserves into corresponding catalogue.
In the present embodiment, the computer on backstage will be redrawn according to mobile trace of the infrared pen on content of pages, i.e.,
The region corresponding to computer redraws the mobile trace of infrared pen according to a certain percentage, with formed contain redraw trace and
The picture of background transparent, the picture are the notes triggered corresponding to the content of pages of infrared pen movement.
By being stored in the form of containing the picture for redrawing trace and background transparent to taking down notes, and volume is not needed to
Other places correspondence stores the content of pages corresponding to it, greatly saves memory space, also avoids the redundancy of storage.
Pass through interactive process as described above so that user even by the mode that projection is read carry out e-book or
The reading of paper book can also be written to the content in e-book or paper book and take down notes, and greatly facilitate the projection that user is carried out
Formula is read so that projection reads the mode that also can adapt to current mankind reading, and then improves user's progress projection and read
The adaptability of reading.
In the realization interactive process that projection as described above is read, form under two kinds of scenes of paper book and e-book
Interaction so that user no matter possess which type of books can by method as described above realize projection read with
And interaction, greatly improve the scope of application of projection reading.
As shown in Fig. 2, in one embodiment, after above-mentioned steps 150, method as described above further comprises following step
Suddenly：
Step 210, triggering carries out page turning to the projection page and obtains the content of pages currently shown in the projection page.
In the present embodiment, intercept after obtaining the instruction that the content of pages in the triggering projection page carries out page turning, by basis
The instruction carries out page turning, and the content of pages shown in the transformation projection page shows the target pages content corresponding to the instruction
In projecting in the page.
Step 230, the notes preserved are extracted from catalogue according to the content of pages currently shown.
It, will be from catalogue after obtaining triggering to the target pages content of projection page progress page turning in the present embodiment
Corresponding notes are extracted, that is, contain the picture for redrawing trace and background transparent.
Step 250, fusion notes and content of pages, and the notes being merged and content of pages are shown in projection page
In face.
In the present embodiment, since notes are to contain the picture for redrawing trace and background transparent, can be directly by notes
It combines together and is shown with content of pages so that both shown that content of pages also showed user and once write in the projection page
The notes entered greatly facilitate user and check.
As shown in figure 3, in another embodiment, the projection page is projected to obtain by e-book, and above-mentioned steps 210 are wrapped
It includes：
Step 211, user gesture is captured, to be obtained currently in the page in the projection page into line trace to user gesture
Hold triggered gesture.
In the present embodiment, user gesture is captured by optical camera, and carry out real-time tracking, it is currently right to obtain user
The gesture that the content of pages shown in the projection page is triggered.
Step 213, the gesture is identified, to obtain triggering the gesture for carrying out page turning to content of pages.
In the present embodiment, to know user view, the hand currently triggered to the content of pages in the projection page will be identified
Gesture, and then know that the gesture is to trigger the gesture that page turning is carried out to content of pages.
For example, the gesture that triggering carries out content of pages downward page turning can be within a certain period of time by right to moving left
Gesture, trigger gesture that content of pages is paged up can be within a certain period of time by the gesture of left-to-right movement, can
As needed and the use habit of user is flexibly set.
Further, be increase gesture identification accuracy, by using depth camera carry out user gesture capture and
Tracking.
Step 215, with triggering content of pages carry out the gesture of page turning the projection page execute corresponding page turning action with
The content of pages after page turning is obtained, and is shown in the projection page.
In the present embodiment, it is followed by the gesture that triggering content of pages carries out page turning, page turning will be executed in projecting the page and moved
Make, the content of pages being currently shown in the projection page is stirred to target pages content.
In addition, capturing and the user gesture that identifies also contracts page amplification required when including reading and the page
The gestures such as small, are not enumerated one by one herein.
As shown in figure 4, in one embodiment, the content of pages projected in the page is to project to obtain to the cover of paper book
Cover image, method as described above further includes：
Step 410, finger image is carried out to cover image to analyze to obtain corresponding book information.
In the present embodiment, the paper book page is sayed, the content of pages corresponding to every page is in the form of images
Existing, i.e., paper book image therefore, will be to being projected on paper in the projection page for the book information for obtaining corresponding to paper book
The cover image of matter book carries out finger image analysis.
Specifically, cover image will be captured by optical camera, the cover image of capture is transferred to the calculating on backstage
In machine, computer will carry out cover image feature extraction, and special in the books pre-established according to the feature extracted
Characteristic matching is carried out in sign database, to search on the books for obtaining matching with the feature that extraction obtains, and then is obtained corresponding
Book information, wherein book information has recorded the information such as publication title, is stored in the books property data base pre-established
Feature and with book information corresponding to feature.
Step 430, it scans for obtaining the relevant information of paper book according to book information, and projects to the projection page.
In the present embodiment, scan for can be obtained the current papery for carrying out projection reading using book information as keyword
The relevant information of book, for example, the information such as the author of this paper book, publishing house, comment, to facilitate user to read.
As shown in figure 5, in one embodiment, after above-mentioned steps 110, method as described above further comprises following step
Suddenly：
Step 510, the list to be checked of content of pages in the projection page is obtained according to position of the infrared pen in content of pages
Word.
In the present embodiment, after being projected to e-book to obtain projecting the page accordingly, infrared pen will be obtained and existed
Position in content of pages, the word corresponding to the position are the word to be checked that user is inquired.
Specifically, user can realize the click of content of pages in projecting the page by infrared pen the choosing of word to be checked
It is fixed, that is to say, that with the clicking operation that infrared pen triggers content of pages in projecting the page, infrared pen will send out infrared
Line, the infrared ray that infrared camera will capture infrared pen and send out obtain infrared pen in the page to carry out infrared positioning to infrared pen
Position in content, and then word extraction is carried out according to obtained position and can be obtained the to be checked of content of pages in the projection page
Word.
Wherein, infrared pen can be by the infrared elements of a fix into expression, as infrared pen is to the page in the position of content of pages
The click of content, the computer on backstage will carry out ratio according to the infrared elements of a fix and calculate to obtain it relative to the projection page
Position, and then the mouse controlled in the projection page is moved in this position.
Step 530, it is scanned for obtaining corresponding query result according to word to be checked, and projected to the projection page.
In the present embodiment, web search will be carried out using word to be checked as keyword to obtain corresponding query result,
Obtained query result is projected into the projection page, to complete the word enquiring that user is carried out.
As shown in fig. 6, in one embodiment, after above-mentioned steps 410, method as described above further comprises following step
Suddenly：
Step 610, the click triggered in content of pages by infrared pen obtains containing list to be checked in the projection page
The selection area of word.
In the present embodiment, content of pages is to carry out projecting obtained paper book image to paper book, with infrared style of writing
The click of hair will obtain the region being selected in this paper book image, that is, contain the selection area of document to be checked, the choosing
Determine the part that region is paper book image.
Step 630, the e-book being consistent with book information is judged whether, if it has, then 650 are entered step, if
It is no, then enter step 670.
In the present embodiment, analyze to have obtained corresponding figure due to having carried out finger image to the cover image of paper book
Letter ceases, and therefore, will in a computer be scanned for according to book information, to judge whether there is corresponding e-book, if
Have, then the digital form that step 650 acquires word to be checked in chosen area can be directly entered, if it is not, can only
OCR (Optical Character Recognition, optical character identification) technology is used to obtain by step 670 to be checked
Word.
Step 650, extract to obtain the word to be checked that selection area is included by e-book.
In the present embodiment, which is consistent with paper book, for example, possessing identical publication name with paper book
Claim.Content in e-book is searched, to acquire the region that the selection area in e-book with paper book matches,
And the extracted region by acquiring obtains the word to be checked that chosen area is included.
Step 670, word refinement is carried out to the content of pages in the projection page, and according to infrared pen in content of pages
Position obtains word to be checked.
In the present embodiment, when that can not acquire the e-book consistent with paper book, the computer on backstage will use
OCR technique with content of pages existing for paper book image format to carrying out word refinement, and then according to infrared pen in content of pages
In position obtain word to be checked.
Step 690, it is scanned for obtaining corresponding query result according to word to be checked, and projected to the projection page.
In the present embodiment, scan for can be obtained corresponding query result using word to be checked as keyword, and project
Into the projection page, in the content of pages that query result is invested to the projection page.
Interactive method is realized in being read by projection as described above, and it is all will so that projection reading is able to take into account
The books of type, and have abundant interactive function, and realized respectively by way of visible light capture and infrared positioning
Gesture interaction in projection reading and infrared interaction, wherein gesture interaction will be rough for realizing being triggered to the projection page
Operation, and infrared interaction is then for realizing the accurate operation in the projection page, the two be combined with each other, and substantially increases interactive essence
Exactness.
As shown in fig. 7, in one embodiment, a kind of projection realizes interactive system, including projection module in reading
710, mobile position-fixed module 730 and module 750 is redrawn.
Projection module 710, for being projected to e-book or paper book to obtain projecting the page accordingly.
In the present embodiment, e-book is stored in any terminal equipment existing in digital form, and paper book is then
It is existing in paper form.The projection page is the region that projector projects go out, and in a preferred embodiment, which is rectangle region
Domain.
According to the needs that Current projection formula is read, projection module 710 projects e-book or paper book, to obtain phase
The projection page answered is shown in the content in e-book or paper book as content of pages in the projection page, and then realizes more
Reading between people is shared.
Mobile position-fixed module 730 obtains infrared in the projection page for the movement of infrared pen in infrared positioning projection's page
Mobile trace of the pen on content of pages.
In the present embodiment, infrared pen by for realizing user and projection the page between interactive operation, to realize projection
The random manipulation read.Specifically, mobile position-fixed module 730 by by infrared camera record infrared pen sent out it is infrared
Line, record project the infrared pen movement occurred in the page, to obtain movement of the infrared pen on content of pages in the projection page
Trace completes mobile the carried out infrared positioning to infrared pen.
For example, during carrying out projection reading by projecting the content of pages shown by the page, if desired emphasis
Mark certain passage, then the controllable infrared pen of user moves on this section of word, at this point, mobile infrared pen sent out it is red
Outside line has corresponded to this section of literal mobile trace.
Module 750 is redrawn, for being redrawn according to the mobile trace of infrared pen to generate the corresponding notes of content of pages,
And notes are preserved into corresponding catalogue.
In the present embodiment, module 750 is redrawn by the movement according to infrared pen on content of pages in the computer on backstage
Trace is redrawn, i.e., the region according to a certain percentage corresponding to computer redraws the mobile trace of infrared pen, to be formed
The picture for redrawing trace and background transparent is contained, which is the pen triggered corresponding to the content of pages of infrared pen movement
Note.
Module 750 is redrawn by being stored in the form of containing the picture for redrawing trace and background transparent to taking down notes,
And do not need to extraly it is corresponding storage its corresponding to content of pages, greatly save memory space, also avoid storage
Redundancy.
Pass through interactive process as described above so that user even by the mode that projection is read carry out e-book or
The reading of paper book can also be written to the content in e-book or paper book and take down notes, and greatly facilitate the projection that user is carried out
Formula is read so that projection reads the mode that also can adapt to current mankind reading, and then improves user's progress projection and read
The adaptability of reading.
In the realization interactive process that projection as described above is read, form under two kinds of scenes of paper book and e-book
Interaction so that user no matter possess which type of books can by method as described above realize projection read with
And interaction, greatly improve the scope of application of projection reading.
As shown in figure 8, in one embodiment, system as described above further comprises page processing module 810, notes carry
Modulus block 830 and Fusion Module 850.
Page processing module 810 obtains the page currently shown in the projection page for triggering to projection page progress page turning
Face content.
In the present embodiment, intercept after obtaining the instruction that the content of pages in the triggering projection page carries out page turning, at page turning
Page turning, the content of pages shown in the transformation projection page, by the mesh corresponding to the instruction will be carried out according to the instruction by managing module 810
Mark content of pages is shown in the projection page.
Extraction module 830 is taken down notes, for extracting the notes preserved from catalogue according to the content of pages currently shown.
In the present embodiment, after obtaining triggering to the target pages content of projection page progress page turning, notes extraction mould
Block 830 will extract corresponding notes from catalogue, that is, contain the picture for redrawing trace and background transparent.
Fusion Module 850 for merging notes and content of pages, and the notes being merged and content of pages is shown
In projecting in the page.
In the present embodiment, since notes are to contain the picture for redrawing trace and background transparent, Fusion Module 850
Directly notes can be combined together with content of pages and be shown so that both show that content of pages was also shown in the projection page
The notes that user was once written, greatly facilitate user and check.
As shown in figure 9, in one embodiment, the projection page is projected to obtain by e-book, above-mentioned page processing mould
Block 810 includes gesture capturing unit 811, recognition unit 813 and page turning execution unit 815.
Gesture capturing unit 811, for capturing user gesture, to be obtained currently into line trace to projecting page to user gesture
The gesture that content of pages in face is triggered.
In the present embodiment, user gesture is captured by gesture capturing unit 811, and carry out real-time tracking, to obtain user
The gesture that currently content of pages shown in the projection page is triggered.The gesture capturing unit 811 can be optical camera.
Recognition unit 813, the gesture for identification, to obtain triggering the gesture for carrying out page turning to content of pages.
In the present embodiment, to know that user view, recognition unit 813 will identify currently to the content of pages in the projection page
The gesture triggered, and then know that the gesture is to trigger the gesture that page turning is carried out to content of pages.
For example, the gesture that triggering carries out content of pages downward page turning can be within a certain period of time by right to moving left
Gesture, trigger gesture that content of pages is paged up can be within a certain period of time by the gesture of left-to-right movement, can
As needed and the use habit of user is flexibly set.
Further, to increase the accuracy of gesture identification, gesture capturing unit can be depth camera, to carry out user
The capture and tracking of gesture.
Page turning execution unit 815, the gesture for carrying out page turning with content of pages are turned over accordingly in projection page execution
Page action is shown in obtaining the content of pages after page turning in the projection page.
In the present embodiment, it is followed by the gesture that triggering content of pages carries out page turning, page turning execution unit 815 will be in projection page
Page turning action is executed in face, and the content of pages being currently shown in the projection page is stirred to target pages content.
In addition, capturing and the user gesture that identifies also contracts page amplification required when including reading and the page
The gestures such as small, are not enumerated one by one herein.
As shown in Figure 10, in one embodiment, the content of pages projected in the page is projected to the cover of paper book
The cover image arrived, system as described above further include finger image analysis module 1010 and books search module 1030.
Finger image analysis module 1010 is analyzed to obtain corresponding books letter for carrying out finger image to cover image
Breath.
In the present embodiment, the paper book page is sayed, the content of pages corresponding to every page is in the form of images
Existing, i.e. paper book image, therefore, for the book information for obtaining corresponding to paper book, finger image analysis module 1010 will
Cover image to being projected on paper book in the projection page carries out finger image analysis.
Specifically, finger image analysis module 1010 will capture cover image by optical camera, by the cover of capture
Image is transferred in the computer on backstage, and computer will carry out cover image feature extraction, and according to the spy extracted
Sign carries out characteristic matching in the books property data base pre-established, obtains and extract what obtained feature matched to search
On books, and then obtain corresponding book information, wherein book information has recorded the information such as publication title, pre-establishes
Stored in books property data base feature and with the book information corresponding to feature.
Books search module 1030, the relevant information for scanning for obtaining paper book according to book information, and project
To the projection page.
In the present embodiment, books search module 1030 scans for can be obtained current progress using book information as keyword
The relevant information for the paper book that projection is read, for example, the information such as the author of this paper book, publishing house, comment, to facilitate use
It reads at family.
As shown in figure 11, in one embodiment, system as described above further comprises word locating module 1110 and
One word search module 1130.
Word locating module 1110, for being obtained in the projection page in the page according to position of the infrared pen in content of pages
The word to be checked held.
In the present embodiment, after being projected to e-book to obtain projecting the page accordingly, word locating module
1110 will obtain position of the infrared pen in content of pages, and the word corresponding to the position is waiting for of being inquired of user
Looking up words.
Specifically, user can realize the click of content of pages in projecting the page by infrared pen the choosing of word to be checked
It is fixed, that is to say, that with the clicking operation that infrared pen triggers content of pages in projecting the page, infrared pen will send out infrared
Line, the infrared ray that infrared camera will capture infrared pen and send out, word locating module 1110 carry out infrared is positioned to infrared pen
To position of the infrared pen in content of pages, and then word extraction is carried out according to obtained position and can be obtained page in the projection page
The word to be checked of face content.
Wherein, infrared pen can be by the infrared elements of a fix into expression, as infrared pen is to the page in the position of content of pages
The click of content, the word locating module 1110 in the computer on backstage will be carried out according to the infrared elements of a fix ratio calculate with
To its position relative to the projection page, and then the mouse controlled in the projection page is moved in this position.
First word search module 1130 obtains corresponding query result for being scanned for according to word to be checked, and
The projection extremely projection page.
In the present embodiment, the first word search module 1130 will be carried out using word to be checked as keyword web search with
Corresponding query result is obtained, obtained query result is projected into the projection page, is looked into completing the word that user is carried out
It askes.
As shown in figure 12, in one embodiment, system as described above further comprises region acquisition module 1210, judges
Module 1230, word extraction module 1250, word refine module 1270 and the second word search module 1290.
Region acquisition module 1210, the click for being triggered in content of pages by infrared pen obtain wrapping in the projection page
The selection area of word to be checked is contained.
In the present embodiment, content of pages is to carry out projecting obtained paper book image to paper book, with infrared style of writing
The click of hair will obtain the region being selected in this paper book image, that is, contain the selection area of document to be checked, the choosing
Determine the part that region is paper book image.
Judgment module 1230, the e-book for judging whether to be consistent with book information, if it has, then notice word
Extraction module 1250, if it has not, word is then notified to refine module 1270.
In the present embodiment, analyze to have obtained corresponding figure due to having carried out finger image to the cover image of paper book
Letter ceases, and therefore, judgment module 1230 will in a computer be scanned for according to book information, corresponding to judge whether there is
E-book, if so, word extraction module 1250 then can directly be notified to acquire the number of word to be checked in chosen area
Form, if it is not, word can only be notified to refine module 1270 and obtain word to be checked using OCR technique.
Word extraction module 1250, for extracting to obtain the word to be checked that selection area is included by e-book.
In the present embodiment, which is consistent with paper book, for example, possessing identical publication name with paper book
Claim.Word extraction module 1250 searches the content in e-book, selected with paper book in e-book to acquire
The region that region matches, and the extracted region by acquiring obtains the word to be checked that chosen area is included.
Word refines module 1270, and for carrying out word refinement to the content of pages in the projection page, and infrared pen is in page
Position in the content of face obtains word to be checked.
In the present embodiment, when the e-book consistent with paper book can not be acquired, the list in the computer on backstage
Word, which refines module 1270, will use OCR technique to carrying out word refinement with content of pages existing for paper book image format, in turn
Word to be checked is obtained according to position of the infrared pen in content of pages.
Second word search module 1290 obtains corresponding query result for being scanned for according to word to be checked, and
The projection extremely projection page.
In the present embodiment, the second word search module 1290 scans for can be obtained phase using word to be checked as keyword
The query result answered, and project into the projection page, in the content of pages that query result is invested to the projection page.
Interactive system is realized in being read by projection as described above, and it is all will so that projection reading is able to take into account
The books of type, and have abundant interactive function, and realized respectively by way of visible light capture and infrared positioning
Gesture interaction in projection reading and infrared interaction, wherein gesture interaction will be rough for realizing being triggered to the projection page
Operation, and infrared interaction is then for realizing the accurate operation in the projection page, the two be combined with each other, and substantially increases interactive essence
Exactness.
One of ordinary skill in the art will appreciate that realizing all or part of flow in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, described program can be stored in a computer read/write memory medium
In, in the embodiment of the present invention, which can be stored in the storage medium of computer system, and by the computer system
At least one processor executes, and includes the flow such as the embodiment of above-mentioned each method with realization.Wherein, the storage medium can be
Magnetic disc, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access
Memory, RAM) etc..
Several embodiments of the invention above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
Cannot the limitation to the scope of the claims of the present invention therefore be interpreted as.It should be pointed out that for those of ordinary skill in the art
For, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to the guarantor of the present invention
Protect range.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.
Claims (10)
1. a kind of projection realizes interactive method in reading, include the following steps：
E-book or paper book are projected to obtain projecting the page accordingly；
The movement of infrared pen in the infrared positioning projection page obtains in the projection page infrared pen on content of pages
Mobile trace；
It is redrawn according to the mobile trace of the infrared pen to generate the corresponding notes of the content of pages, and by the notes
It preserves into corresponding catalogue；
The word to be checked of content of pages in the projection page is obtained according to position of the infrared pen in content of pages；
It is scanned for obtaining corresponding query result according to the word to be checked, and projected to the projection page.
2. according to the method described in claim 1, it is characterized in that, the mobile trace according to the infrared pen is redrawn
To generate the corresponding notes of the content of pages, and the notes are preserved to the step in corresponding catalogue, the side
Method further includes：
It triggers and the content of pages currently shown in the projection page is obtained to the projection page progress page turning；
The notes preserved are extracted from catalogue according to the content of pages currently shown；
The notes and content of pages are merged, and the notes being merged and content of pages are shown in the projection page.
3. according to the method described in claim 2, it is characterized in that, the projection page is projected to obtain by e-book, institute
Stating the step of triggering obtains the content of pages currently shown in the projection page to the projection page progress page turning includes：
User gesture is captured, to obtain currently triggering the content of pages in the projection page into line trace to the user gesture
Gesture；
The gesture is identified, to obtain triggering the gesture for carrying out page turning to content of pages；
The gesture for carrying out page turning with the triggering content of pages executes corresponding page turning action to obtain page turning in the projection page
Content of pages afterwards, and be shown in the projection page.
4. according to the method described in claim 1, it is characterized in that, the content of pages in the projection page is to paper book
The cover image that cover projects, the method further include：
Finger image is carried out to the cover image to analyze to obtain corresponding book information；
It is scanned for obtaining the relevant information of the paper book according to the book information, and projected to the projection page, institute
It includes author information, published information, comment information to state relevant information.
5. according to the method described in claim 4, it is characterized in that, described analyze cover image progress finger image
To after the step of corresponding book information, the method further includes：
The click triggered in the content of pages by the infrared pen obtains containing list to be checked in the projection page
The selection area of word；
The e-book being consistent with the book information is judged whether, if it has, then extracting to obtain by the e-book described
The word to be checked that selection area is included, if it has not, then
Word refinement is carried out to the content of pages in the projection page, and is obtained according to position of the infrared pen in content of pages to be checked
Ask word；
It is scanned for obtaining corresponding query result according to the word to be checked, and projected to the projection page.
6. a kind of projection realizes interactive system in reading, which is characterized in that including：
Projection module, for being projected to e-book or paper book to obtain projecting the page accordingly；
Mobile position-fixed module obtains red in the projection page for the movement of infrared pen in the infrared positioning projection page
Mobile trace of the outer pen on content of pages；
Module is redrawn, for being redrawn according to the mobile trace of the infrared pen to generate the corresponding pen of the content of pages
Note, and the notes are preserved into corresponding catalogue；
Word locating module, for being obtained in the projection page in the page according to position of the infrared pen in content of pages
The word to be checked held；
First word search module for scanning for obtaining corresponding query result according to the word to be checked, and projects
To the projection page.
7. system according to claim 6, which is characterized in that the system also includes：
Page processing module obtains the page currently shown in the projection page for triggering to the projection page progress page turning
Face content；
Extraction module is taken down notes, for extracting the notes preserved from catalogue according to the content of pages currently shown；
Fusion Module is shown in for merging the notes and content of pages, and by the notes being merged and content of pages
It projects in the page.
8. system according to claim 7, which is characterized in that the projection page is projected to obtain by e-book, institute
Stating page processing module includes：
Gesture capturing unit, for capturing user gesture, to be obtained currently into line trace to projecting the page to the user gesture
In the gesture that is triggered of content of pages；
Recognition unit, the gesture for identification, to obtain triggering the gesture for carrying out page turning to content of pages；
Page turning execution unit, the gesture for carrying out page turning with the triggering content of pages are turned over accordingly in projection page execution
Page action is shown in obtaining the content of pages after page turning in the projection page.
9. system according to claim 6, which is characterized in that the content of pages in the projection page is to paper book
The cover image that cover projects, the system also includes：
Finger image analysis module is analyzed to obtain corresponding book information for carrying out finger image to the cover image；
Books search module obtains the relevant information of the paper book for being scanned for according to the book information, and projects
To the projection page, the relevant information includes author information, published information, comment information.
10. system according to claim 9, which is characterized in that the system also includes：
Region acquisition module, the click for being triggered in the content of pages by the infrared pen obtain the projection page
In contain the selection area of word to be checked；
Judgment module, the e-book for judging whether to be consistent with the book information, if it has, then notice word extraction
Module, if it has not, word is then notified to refine module；
The word extraction module is used to extract to obtain the word to be checked that the selection area is included by the e-book；
The word refines module and is used to carry out word refinement to the content of pages in the projection page, and according to infrared pen in the page
Position in content obtains word to be checked；
Second word search module for scanning for obtaining corresponding query result according to the word to be checked, and projects
To the projection page.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410244485.9A CN105204752B (en) | 2014-06-04 | 2014-06-04 | Projection realizes interactive method and system in reading |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410244485.9A CN105204752B (en) | 2014-06-04 | 2014-06-04 | Projection realizes interactive method and system in reading |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105204752A CN105204752A (en) | 2015-12-30 |
| CN105204752B true CN105204752B (en) | 2018-08-03 |
Family
ID=54952473
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410244485.9A Expired - Fee Related CN105204752B (en) | 2014-06-04 | 2014-06-04 | Projection realizes interactive method and system in reading |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105204752B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108287895B (en) * | 2018-01-19 | 2020-11-06 | 广东小天才科技有限公司 | Dominant frame adjustment-based question searching method and system and handheld photographing device |
| CN108287903A (en) * | 2018-01-25 | 2018-07-17 | 广东小天才科技有限公司 | It is a kind of to search topic method and smart pen with what projection was combined |
| CN110209762B (en) * | 2018-02-11 | 2021-08-31 | 京东方科技集团股份有限公司 | Reading table and reading method |
| CN111596807B (en) * | 2020-05-22 | 2023-09-19 | 重庆长教科技有限公司 | interactive teaching system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101493636A (en) * | 2008-12-22 | 2009-07-29 | 清华大学深圳研究生院 | Interactive projecting system and interactive input method thereof |
| CN102043320A (en) * | 2009-10-21 | 2011-05-04 | 陕西金合泰克信息科技发展有限公司 | Overhead infrared page turning image book and infrared page turning method thereof |
| CN102880360A (en) * | 2012-09-29 | 2013-01-16 | 东北大学 | Infrared multipoint interactive electronic whiteboard system and whiteboard projection calibration method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012208439A (en) * | 2011-03-30 | 2012-10-25 | Sony Corp | Projection device, projection method and projection program |
-
2014
- 2014-06-04 CN CN201410244485.9A patent/CN105204752B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101493636A (en) * | 2008-12-22 | 2009-07-29 | 清华大学深圳研究生院 | Interactive projecting system and interactive input method thereof |
| CN102043320A (en) * | 2009-10-21 | 2011-05-04 | 陕西金合泰克信息科技发展有限公司 | Overhead infrared page turning image book and infrared page turning method thereof |
| CN102880360A (en) * | 2012-09-29 | 2013-01-16 | 东北大学 | Infrared multipoint interactive electronic whiteboard system and whiteboard projection calibration method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105204752A (en) | 2015-12-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Arai et al. | PaperLink: a technique for hyperlinking from real paper to electronic content | |
| Erol et al. | HOTPAPER: multimedia interaction with paper using mobile phones | |
| US20040193697A1 (en) | Accessing a remotely-stored data set and associating notes with that data set | |
| CN110263746A (en) | Visual search based on posture | |
| CN108959586A (en) | Text vocabulary is identified in response to visual query | |
| JP2011008752A (en) | Document operation system, document operation method and program thereof | |
| US9916499B2 (en) | Method and system for linking printed objects with electronic content | |
| WO2016101717A1 (en) | Touch interaction-based search method and device | |
| CN106462728A (en) | Systems and methods for image-feature-based recognition | |
| CN105631051A (en) | Character recognition based mobile augmented reality reading method and reading system thereof | |
| CN105204752B (en) | Projection realizes interactive method and system in reading | |
| EP2806336A1 (en) | Text prediction in a text input associated with an image | |
| Quack et al. | Object recognition for the internet of things | |
| CN108121987B (en) | Information processing method and electronic equipment | |
| CN109902687A (en) | A kind of image-recognizing method and user terminal | |
| CN111695372B (en) | Click-to-read method and click-to-read data processing method | |
| CN112001380B (en) | Recognition method and system for Chinese meaning phrase based on artificial intelligence reality scene | |
| Pattnaik et al. | A Framework to Detect Digital Text Using Android Based Smartphone | |
| US10217015B2 (en) | Physical and digital bookmark syncing | |
| JP6408055B2 (en) | Information processing apparatus, method, and program | |
| Uchiyama et al. | On-line document registering and retrieving system for AR annotation overlay | |
| Lokkondra et al. | ETDR: An Exploratory View of Text Detection and Recognition in Images and Videos. | |
| Royal et al. | VisionX—a virtual assistant for the visually impaired using deep learning models | |
| CN111461103B (en) | Method and device for eliminating interference of click-to-read scene, electronic equipment and storage medium | |
| Xie et al. | D-Note: computer-aided digital note taking system on physical book |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180803 Termination date: 20200604 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |