CN103116597A - Image-based information access device and method - Google Patents

Image-based information access device and method Download PDF

Info

Publication number
CN103116597A
CN103116597A CN2012104495254A CN201210449525A CN103116597A CN 103116597 A CN103116597 A CN 103116597A CN 2012104495254 A CN2012104495254 A CN 2012104495254A CN 201210449525 A CN201210449525 A CN 201210449525A CN 103116597 A CN103116597 A CN 103116597A
Authority
CN
China
Prior art keywords
key message
picture
information
search results
search
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012104495254A
Other languages
Chinese (zh)
Inventor
H-P·彭
M·雅各布
R·R·科苏里
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Marvell International Ltd
Original Assignee
Marvell International Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Marvell International Ltd filed Critical Marvell International Ltd
Publication of CN103116597A publication Critical patent/CN103116597A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides an image-based information access device and method. The method is used for identifying one or more pieces of key information in the images, searching related information aiming at the one or more pieces of key information, and associating the one or more pieces of key information with corresponding searching results. According to the method, users are enabled to simply and easily find key information while obtaining a picture, and just through simply clicking the key information, further detailed information can be obtained, thereby simplifying user's operation and accelerating the speed of operation.

Description

Information acquisition device and method based on picture
Technical field
Embodiments of the present invention relate to the acquisition of information field, more specifically, relate to a kind of for information acquisition device and method based on the picture input.
Background technology
Along with the high speed development of computer and network technologies and universal, transmit between the user in the message of (such as by transmission such as mail, short messages) and often comprise a large amount of pictures.Carry the multiple information that needs transmission in these pictures.
When the user for example received this class picture, he/her often needs to experience the processes such as the important information that oneself judges in picture, the display page that withdraws from picture, unlatching searched page, search information could obtain the important information relevant to this picture.Very complicated loaded down with trivial details is unfavorable for user's operation.
Summary of the invention
In order to solve the above-mentioned problems in the prior art, this instructions proposes following scheme.
According to a first aspect of the invention, provide a kind of information getting method based on picture, comprising: identify one or more key message in described picture; For described one or more key message relevant search information; And carry out related with its corresponding Search Results described one or more key message respectively.Wherein, described search can be carried out in the Internet and/or hardware memory.And wherein, can be in the information that described picture comprises choose described one or more key message based on one or more in correlativity, explicitly and the outward appearance of information.The method can further include and highlight described one or more key message in described picture.Wherein, described highlighting can comprise with lower one or more: highlighted, runic shows, italic shows, underlines, changes color, changes font, adds animation.The method can further include: described one or more key message of operation is to obtain its corresponding Search Results in described picture.Wherein, described operation comprises click, touches and/or hovers.In the method, one or more in described identification, described search, described association and described highlighting can be for carrying out automatically.And wherein, described picture can be digital picture.
According to a second aspect of the invention, provide a kind of information acquisition device based on picture, comprising: recognition device is configured to identify one or more key message in described picture; Searcher is configured to for described one or more key message relevant search information; And associated apparatus, be configured to carry out related with its corresponding Search Results described one or more key message respectively.Wherein, described search can be carried out in the Internet and/or hardware memory.And wherein, can be in the information that described picture comprises choose described one or more key message based on one or more in correlativity, explicitly and the outward appearance of information.This device can further include: highlight device, be configured to highlight described one or more key message in described picture.In addition, described highlighting can comprise with lower one or more: highlighted, runic shows, italic shows, underlines, changes color, changes font, adds animation.This device can further include: operating means is configured to operate described one or more key message to obtain its corresponding Search Results in described picture.Wherein, described operation can comprise click, touches and/or hover.In this device, one or more in described identification, described search, described association and described highlighting can be for carrying out automatically.And wherein, described picture can be digital picture.
According to the embodiment of the present invention, the user receiving or obtaining in the situation of a pictures (for example, digital picture), and he/her also can automatically obtain the information relevant to this picture, for example, and the Internet search results relevant to word in picture; And the acquisition of this result only needs the user to click in photo current, touch or cursor hovers is got final product on its interested word.
Description of drawings
Also with reference to following detailed description, the feature of each embodiment of the present invention, advantage and other aspects will become more obvious by reference to the accompanying drawings.
Fig. 1 show according to of the present invention, be used for the process flow diagram based on the information getting method 100 of picture input.
Fig. 2 show according to of the present invention, be used for the block diagram based on the information acquisition device 200 of picture input.
Fig. 3 A and 3B show according to exemplary embodiment of the invention, example that be used for coming based on picture input obtaining information; And
Fig. 4 shows the schematic block diagram of the computer system 400 that is suitable for putting into practice embodiment of the present invention.
Embodiment
Below with reference to some illustrative embodiments, principle of the present invention and spirit are described.Should be appreciated that providing these embodiments is only in order to make those skilled in the art can understand better and then realize the present invention, and be not to limit the scope of the invention by any way.
Should be noted that process flow diagram and block diagram in accompanying drawing, illustrate the device according to various embodiments of the invention, architectural framework in the cards, function and the operation of method and computer program product.In this, each square frame in process flow diagram or block diagram can represent the part of module, program segment or a code, and the part of described module, program segment or code comprises the executable instruction of one or more logic functions for realizing regulation.Should be noted that also what the function that marks in square frame also can be marked to be different from accompanying drawing occurs in sequence in some realization as an alternative.For example, in fact the square frame that two adjoining lands represent can be carried out substantially concurrently, and they also can be carried out by opposite order sometimes, and this decides according to related function.Also be noted that, each square frame in block diagram and/or process flow diagram and the combination of the square frame in block diagram and/or process flow diagram, can realize with the hardware based system of the special use of the function that puts rules into practice or operation, perhaps can realize with the combination of specialized hardware and computer instruction.
Fig. 1 show according to of the present invention, be used for the process flow diagram based on the information getting method 100 of picture input.Each step that it should be understood that record in method 100 can be carried out according to different orders, and/or executed in parallel.Method 100 can also comprise additional step and/or omit the step shown in carrying out.Scope of the present invention is unrestricted in this regard.
According to method 100, when (for example numeral) picture was sent to the user place or is otherwise obtained by the user, at first method 100 entered step S102, one or more key message in the identification picture.Here alleged term " key message " for example comprises the relevant information that can reflect the picture presented content.Generally speaking, the information that comprises in picture has multiple, for example word, icon and image of the various fonts in picture and size etc.In the preferred embodiment of the present invention, this key message is chosen based on the one or more factors in correlativity (relevance), explicitly and the outward appearance of the various information that comprise in picture.For example in the example of Fig. 3 A and 3B, Science Festival and CAL STATE EASTBAY are chosen automatically as key message.
Next, method 100 enters step S104, for described one or more key message relevant search information.In the preferred embodiment of the present invention, this search is carried out in the Internet and/or hardware memory.It will be understood by those skilled in the art that this search can also be in office what its digital storage locations place carry out, the present invention is unrestricted in this regard.In the example of Fig. 3 A, for the Search Results of for example key message Science Festival might be Internet search for example to about what be " Science Festival " explanation, science joint (Science Festival) by California State University (CAL STATE EAST BAY) patronage, etc.
In case search is completed, method 100 enters step S106, respectively its corresponding Search Results of each key message is carried out association.By step S106, can so that when this key message of operation on picture, can obtain to associated Search Results correspondingly.In the preferred embodiment of the present invention, operation can include but not limited to mouse click, operation touches and/or hovers etc.
So far, method 100 finishes.
In fact, the step S102-S106 in method 100 only shows an embodiment of the invention, and according to another preferred implementation, method 100 can also be included in the step that highlights described one or more key message in picture.Here alleged highlighting can for example include but not limited to lower one or more: highlighted, runic shows, italic shows, underlines, changes color, changes font, adds animation etc.The example that highlights has been shown in Fig. 3 B: the key message Cal State East Bay and the ScienceFestival that choose have been added underscore to highlight before.
Highlight and respectively carry out related with the relevant information that searches one or more key message at step S106 by this, can be so that find at an easy rate this key message the user in picture, and only need click simply each key message and can obtain associated further information, effectively simple in the extreme.
In addition, note also that, step S102-S106 and this step that highlights all can need not user's interference and automatically carry out.
Next with reference to Fig. 2 further describe according to of the present invention, be used for the block diagram based on the information acquisition device 200 of picture input.
As shown in the figure, device 200 comprises recognition device 201, be configured to identify one or more key message in described picture, searcher 202, be configured to for described one or more key message relevant search information, and associated apparatus 202, be configured to carry out related with its corresponding Search Results described one or more key message respectively.
In optional embodiment of the present invention, described search is carried out in the Internet and/or hardware memory.
In optional embodiment of the present invention, choose described one or more key message based on one or more in correlativity, explicitly and the outward appearance of information in the information that described picture comprises.
In optional embodiment of the present invention, device 200 further comprises and highlights device 204, is configured to highlight described one or more key message in described picture.Optionally, wherein said highlighting comprises with lower one or more: highlighted, runic shows, italic shows, underlines, changes color, changes font, adds animation.
In optional embodiment of the present invention, device 200 further comprises operating means 205, is configured to operate described one or more key message to obtain its corresponding Search Results in described picture.Optionally, described operation comprises click, touches and/or hovers.
In optional embodiment of the present invention, one or more for automatically carrying out in described identification, described search, described association and described highlighting.
In optional embodiment of the present invention, described picture is digital picture.
Fig. 4 shows the schematic block diagram of the computer system that is suitable for putting into practice embodiment of the present invention.As shown in Figure 4, computer system can comprise: CPU (CPU (central processing unit)) 401, RAM (random access memory) 402, ROM (ROM (read-only memory)) 403, system bus 404, hard disk controller 405, keyboard controller 406, serial interface controller 407, parallel interface controller 408, display controller 409, hard disk 410, keyboard 411, serial external unit 412, parallel external unit 413 and display 414.In these equipment, with system bus 404 coupling CPU401, RAM 402, ROM 403, hard disk controller 405, keyboard controller 406, serialization controller 407, parallel controller 408 and display controller 409 arranged.Hard disk 410 and hard disk controller 405 couplings, keyboard 411 and keyboard controller 406 couplings, serial external unit 412 and serial interface controller 407 couplings, parallel external unit 413 and parallel interface controller 408 couplings, and display 414 and display controller 409 couplings.
Should be appreciated that the described structured flowchart of Fig. 4 illustrates just to the purpose of example, rather than limitation of the scope of the invention.In some cases, can increase or reduce as the case may be some equipment.
Especially, except the hardware implementation mode, embodiments of the present invention can realize by the form of computer program.For example, the method 100 of describing with reference to figure 1 can realize by computer program.This computer program can be stored in RAM for example shown in Figure 4 404, ROM 404, hard disk 410 and/or any suitable storage medium, perhaps downloads on computer system 400 from suitable position by network.Computer program can comprise the computer code part, and it comprises can be by the programmed instruction of suitable treatment facility (for example, the CPU shown in Fig. 4 401) execution.Described programmed instruction can comprise at least: is used for and will has mutual content with the user during loading game, be taken into the instruction of one or more user interactive module, but wherein said user interactive module independent loads; And the instruction that is used for the described user interactive module of preferential loading.
Above spirit of the present invention and principle have been explained in conjunction with some embodiments.According to the embodiment of the present invention, can be so that the user simply easily finds important information (key message) when obtaining a certain picture, and only can obtain associated further details by this key message of simple click, simplify user's operation and accelerated the speed that operates.
Should be noted that embodiments of the present invention can realize by the combination of hardware, software or software and hardware.Hardware components can utilize special logic to realize; Software section can be stored in storer, and by suitable instruction execution system, for example microprocessor or special designs hardware are carried out.Those having ordinary skill in the art will appreciate that above-mentioned equipment and method can and/or be included in the processor control routine with computer executable instructions realizes, for example provides such code on such as the mounting medium of disk, CD or DVD-ROM, such as the programmable memory of ROM (read-only memory) (firmware) or the data carrier such as optics or electronic signal carrier.Equipment of the present invention and module thereof can be by such as VLSI (very large scale integrated circuit) or gate array, realize such as the semiconductor of logic chip, transistor etc. or such as the hardware circuit of the programmable hardware device of field programmable gate array, programmable logic device etc., also can use the software of being carried out by various types of processors to realize, also can by the combination of above-mentioned hardware circuit and software for example firmware realize.
Although should be noted that some devices or the sub-device of having mentioned equipment in above-detailed, this division is not only enforceable.In fact, according to the embodiment of the present invention, the feature of above-described two or more devices and function can be specialized in a device.Otherwise, the feature of an above-described device and function can Further Division for to be specialized by a plurality of devices.
Although described the present invention with reference to some embodiments, should be appreciated that, the present invention is not limited to disclosed embodiment.The present invention is intended to contain interior included various modifications and the equivalent arrangements of spirit and scope of claims.The scope of claims meets the most wide in range explanation, thereby comprises all such modifications and equivalent structure and function.

Claims (16)

1. information getting method based on picture comprises:
Identify one or more key message in described picture;
For described one or more key message, the automatic search relevant information is as Search Results; And
Carry out related with described Search Results described one or more key message.
2. method according to claim 1 wherein saidly comprises for described one or more key message relevant search information: the search information relevant to described one or more key message in the Internet and/or hardware memory.
3. method according to claim 1, one or more key message in the described picture of wherein said identification comprises: in the information that described picture comprises, choose described one or more key message based on one or more in correlativity, explicitly and the outward appearance of information.
4. method according to claim 1 further comprises:
Highlight described one or more key message in described picture.
5. method according to claim 4, wherein, described highlighting comprises with lower one or more: highlighted, runic shows, italic shows, underlines, changes color, changes font, adds animation.
6. according to claim 1-5 arbitrary described method further comprises:
Described one or more key message of operation is to obtain its corresponding Search Results in described picture.
7. method according to claim 6, wherein, described operation comprises click, touches and/or hovers.
8. according to claim 1-5 arbitrary described method, wherein, described picture is digital picture.
9. information acquisition device based on picture comprises:
Recognition device is configured to identify one or more key message in described picture;
Searcher is configured to for described one or more key message, and the automatic search relevant information is as Search Results; And
Associated apparatus is configured to carry out related with described Search Results described one or more key message.
10. device according to claim 9, wherein said searcher is searched in the Internet and/or hardware memory.
11. device according to claim 9, wherein said recognition device are chosen described one or more key message based on one or more in correlativity, explicitly and the outward appearance of information in the information that described picture comprises.
12. device according to claim 9 further comprises:
Highlight device, be configured to highlight described one or more key message in described picture.
13. device according to claim 12, wherein said highlighting of highlighting that device carries out comprises with lower one or more: highlighted, runic shows, italic shows, underlines, changes color, changes font, adds animation.
14. according to claim 9-13 arbitrary described device further comprises:
Operating means is configured to operate described one or more key message to obtain its corresponding Search Results in described picture.
15. it is one of following that device according to claim 14, the operation that wherein said operating means is carried out comprise: click, touch and hover.
16. according to claim 9-13 arbitrary described system, wherein, described picture is digital picture.
CN2012104495254A 2011-11-14 2012-11-12 Image-based information access device and method Pending CN103116597A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201161559441P 2011-11-14 2011-11-14
US61/559,441 2011-11-14

Publications (1)

Publication Number Publication Date
CN103116597A true CN103116597A (en) 2013-05-22

Family

ID=48414972

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012104495254A Pending CN103116597A (en) 2011-11-14 2012-11-12 Image-based information access device and method

Country Status (1)

Country Link
CN (1) CN103116597A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106097439A (en) * 2016-06-15 2016-11-09 维沃移动通信有限公司 A kind of method building object three-dimensional model and electronic equipment
CN107092603A (en) * 2016-02-18 2017-08-25 腾讯科技(深圳)有限公司 A kind of image identification method and device
CN107491512A (en) * 2017-08-07 2017-12-19 上海斐讯数据通信技术有限公司 A kind of method and system that content search is carried out based on picture recognition

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101183396A (en) * 2007-12-27 2008-05-21 深圳市迅雷网络技术有限公司 Advertisement display process, system and device
US20080143880A1 (en) * 2006-12-14 2008-06-19 Samsung Electronics Co., Ltd. Method and apparatus for detecting caption of video
CN101329675A (en) * 2007-06-19 2008-12-24 百度在线网络技术(北京)有限公司 Method and system for matching web page advertisement
CN101539918A (en) * 2008-03-19 2009-09-23 天下互联(北京)科技有限公司 Method and system for internet search
CN101719142A (en) * 2009-12-10 2010-06-02 湖南大学 Method for detecting picture characters by sparse representation based on classifying dictionary
CN101930457A (en) * 2010-08-13 2010-12-29 百度在线网络技术(北京)有限公司 Quick object selecting and searching method, equipment and system for user

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080143880A1 (en) * 2006-12-14 2008-06-19 Samsung Electronics Co., Ltd. Method and apparatus for detecting caption of video
CN101329675A (en) * 2007-06-19 2008-12-24 百度在线网络技术(北京)有限公司 Method and system for matching web page advertisement
CN101183396A (en) * 2007-12-27 2008-05-21 深圳市迅雷网络技术有限公司 Advertisement display process, system and device
CN101539918A (en) * 2008-03-19 2009-09-23 天下互联(北京)科技有限公司 Method and system for internet search
CN101719142A (en) * 2009-12-10 2010-06-02 湖南大学 Method for detecting picture characters by sparse representation based on classifying dictionary
CN101930457A (en) * 2010-08-13 2010-12-29 百度在线网络技术(北京)有限公司 Quick object selecting and searching method, equipment and system for user

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107092603A (en) * 2016-02-18 2017-08-25 腾讯科技(深圳)有限公司 A kind of image identification method and device
CN106097439A (en) * 2016-06-15 2016-11-09 维沃移动通信有限公司 A kind of method building object three-dimensional model and electronic equipment
CN106097439B (en) * 2016-06-15 2018-10-19 维沃移动通信有限公司 A kind of method and electronic equipment of structure object three-dimensional model
CN107491512A (en) * 2017-08-07 2017-12-19 上海斐讯数据通信技术有限公司 A kind of method and system that content search is carried out based on picture recognition

Similar Documents

Publication Publication Date Title
US9928232B2 (en) Topically aware word suggestions
US10768772B2 (en) Context-aware recommendations of relevant presentation content displayed in mixed environments
US9009092B2 (en) Creating variations when transforming data into consumable content
US9208216B2 (en) Transforming data into consumable content
US20170293419A1 (en) Method and system for context based tab management
CN106663108B (en) Deep links for native applications
US20140282358A1 (en) Software Product Capable of Using Zero and Third Party Applications
EP2875448A2 (en) Abstract relational model for transforming data into consumable content
RU2595524C2 (en) Device and method for processing content of web resource in browser
CA2857409A1 (en) Quick analysis tool for spreadsheet application programs
US20120296746A1 (en) Techniques to automatically search selected content
CN106687949A (en) Search results for native applications
US9934331B2 (en) Query suggestions
US11500953B2 (en) Indexing native application data
US11442905B2 (en) Efficient denormalization of data instances
US10089412B2 (en) Method of and system for processing a search query
US9047300B2 (en) Techniques to manage universal file descriptor models for content files
CN103116597A (en) Image-based information access device and method
US20170193119A1 (en) Add-On Module Search System
US10592572B2 (en) Application view index and search
US20150135111A1 (en) Utilizing object cloning to enable nested drag and drop
JPWO2015016133A1 (en) Information management apparatus and information management method
US20150378530A1 (en) Command surface drill-in control
KR102382303B1 (en) Method and apparatus for detecting bluetooth
US9851875B2 (en) System and method thereof for generation of widgets based on applications

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20130522

RJ01 Rejection of invention patent application after publication