CN101556611B - Image searching method based on visual features - Google Patents
Image searching method based on visual features Download PDFInfo
- Publication number
- CN101556611B CN101556611B CN200910107050.9A CN200910107050A CN101556611B CN 101556611 B CN101556611 B CN 101556611B CN 200910107050 A CN200910107050 A CN 200910107050A CN 101556611 B CN101556611 B CN 101556611B
- Authority
- CN
- China
- Prior art keywords
- boundary line
- pixel
- transition boundary
- searching
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Image Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to an image recognition and searching technology. By taking a standard thumbnail of an image as an object, characteristic variables such as hue of color, saturation, brightness, grayscale, planimetric position and the like are quantified and assigned; on the basis, a characteristic spectral line of a single characteristic variable, namely, a set of a jump boundary line of thesingle characteristic variable, is formed; and a tangential line is made to the jump boundary line of the single characteristic variable for each pixel, and the tangential line direction is taken asa characteristic value of the single characteristic variable at the pixel. The technology has simple operation, and does not require the user to have professional knowledge background. An intersectioncharacteristic value of a curve input by the user and the characteristic spectral line of the single characteristic variable is taken as basic data for image recognition. When searching images, dataprocessing quantity at a client and a server end is small. The image recognition and searching technology can be widely applicable to the fields such as image recognition, internet image searching engines, mobile terminal image searching, and the like, and also can be combined with 'keywords' searching so as to optimize the existing image searching mode.
Description
(1) technical field:
The present invention relates to identification and the search technique of picture, particularly relate to the selection of picture feature variable and the analysis to picture feature spectral line and extracting method and the application in identification and the search of picture thereof.
(2) background technology:
Based on visual signature or content-based picture searching technical research from first business-like content-based image with dynamically scene searching system---the QBIC of IBM Corporation has had the history of more than ten years till now.
Now similar techniques main on our times is done to an introduction:
1.QBIC (Query By Image Content) image indexing system is image and the dynamic scene searching system of the IBM Corporation's exploitation and composition nineties, is first content-based business-like image indexing system.QBIC system provides multiple inquiry mode, comprise: utilize standard model figure (self provides system) retrieval, user draws sketch or scanning input picture is retrieved, and selects color or structure query mode, and user inputs the object retrieval moving in motion video fragment and prospect.In the time of user's input picture, sketch or video fragment, QBIC carries out the features such as color, texture, shape to the query image of input and carries out analysis and drawing out, and the inquiry mode of then selecting according to user carries out respectively different processing.The color characteristic colored number percent, the color position distribution etc. that in QBIC, use; The textural characteristics using is that the one representing according to the texture of Tamura proposition is improved, and combines the characteristic of roughness, contrast and directivity; The shape facility using has area, circularity, degree of eccentricity, main shaft deflection and one group of algebraically square invariant.QBIC or a few have been considered one of system of indexing of high dimensional features.QBIC, except the retrieval of content-based characteristic above, is also aided with text query means.
2.Virage is the CBIR engine of being developed by Virage company. the same with QBIC system, it also supports the image retrieval based on visual signatures such as color, color layout, texture and structures.
VIR (the Visual Information Retrieval) image engine of VIRAGE company provides four kinds of visual attributes retrievals (color, composition, texture and shape).Every kind of attribute is endowed 0 to 10 weights.It is the most simple and clear retrieving by color characteristics, and tone, color and the degree of saturation of this software to the base image of selecting analyzed, and then in image library, searches and the immediate image of these color attributes.Composition (composition) characteristic refers to the degree of approximation in relevant colors region.User can set one or more attribute weights and optimize retrieval.Reaching optimum balance degree needs repetition test, but retrieving is quickish.In result display matrix, can select to check 3,6,9,12,15 or 18 sketches.By the adjustment to four attribute weights, demonstrate different result for retrieval.Sketch is according to similarity descending sort.Click sketch title by obtaining some detailed descriptions of this image, comprise the ratio of similitude that Virage calculates.
3.RetrievalWare is a kind of CBIR instrument of being developed by Excalibur Science and Technology Ltd..In earlier version, can see this system focus on use neural network algorithm to realize image retrieval.In newer version, r provides the retrieval based on 6 kinds of image attributes, is respectively color, shape, texture, color structure, brightness structure and aspect ratio.Color attribute is that color to image and shared ratio thereof are measured, but does not comprise structure to color or the mensuration of position, and this is by color structure property control; Shape attribute refers to the profile of objects in images or the relative orientation of lines, flexibility and contrast; Texture properties refers to smoothness or the roughness of image, the character of surface of a width figure; Brightness attribute refers to the brightness of the pixel combination of composing images.
4.Photobook be the multi-media Laboratory of Massachusetts Institute Technology develop for image querying and the interactive tool browsed.It is made up of three subsystems, is responsible for respectively extracting shape, texture, facial characteristics.Therefore, user can carry out respectively based on shape, based on texture and the image retrieval based on facial characteristics in these three subsystems.
5.VisualSEEK is the gopher based on visual signature, and WebSEEK is a kind of text towards WWW or image search engine.These two searching systems are all developed by Columbia University.Their principal feature is the visual signature that has adopted spatial relationship between image-region and extracted from compression domain.The visual signature that system adopts is to utilize color set and the textural characteristics based on wavelet transformation.VisualSEEK supports the inquiry based on visual signature and the inquiry based on spatial relationship simultaneously.WebSEEK comprises three main modular: image/video acquisition module, subject classification and index module, search, browse and retrieval module.
Without exception, these based on visual signature or content-based picture searching technology in, texture and shape are two kinds of different attributes.It is higher that complicated algorithm and structure require the structure of knowledge of the user to using these technology.Algorithm complexity, data processing amount is bigger than normal, and the many features of manual intervention are also apparent to the cost pressure of large-scale commercial applications operation.
(3) summary of the invention:
Technical matters to be solved by this invention is: in the identification and search of picture, select suitable picture feature variable and picture feature characteristics of variables spectral line is analyzed, adopt the Eigenvalue Extraction Method that reduces deal with data amount, reduce the popular universal difficulty using.
Because client process data volume is little, easy operating, can be widely used in the field such as internet photographic search engine, mobile terminal picture search.
Owing to can arbitrarily determining according to user intention effective coverage and the content of search, can also be used for the picture searching field of subscriber's local computing machine again.
For solving above technical matters, the present invention is disclosing following technical scheme.
(4) embodiment:
A realization for image searching method based on visual signature, comprising:
By characteristic variable quantification assignment such as the form and aspect of picture, saturation degree, brightness, gray scale and planimetric positions.
Transfer the picture file in picture library to standard thumbnail according to setting physical dimension.
Obtain form and aspect, saturation degree, brightness, gray scale and the plane positional number value of the each pixel of standard thumbnail, form a property data base of standard thumbnail single features variable.
Standard thumbnail, according to the different accuracy of identification analyses of setting, is formed to the transition boundary line of single features variable.And formed the characteristic spectral line of the single features variable of each picture file standard thumbnail by whole transition boundary lines.All the single features characteristics of variables spectral line of picture file standard thumbnail forms the quadratic character database of this characteristic variable.
On single features variable transition boundary line, the tangential direction of each pixel position forms three property data bases of this characteristic variable.
The full property data base of property data base, quadratic character database and three property data base formation picture library picture standard thumbnail.Full property data base is associated with the URL (Uniform Resoure Locator) of picture file in picture library.
When search, on the picture as sample file, the one or more continuous or discontinuous curve that passes through " search target " of obtaining using computer entry device is as " search condition ".Common factor to " search condition " with transition boundary line, the numerical value such as the tangential direction according to its form and aspect, saturation degree, brightness, gray scale, planimetric position and transition boundary line on this pixel (point bunch) are compared with full property data base, complete single features variable or many characteristic variables combinatorial search.
Search result be returned as with " search condition " degree of agreement meet predefined picture with and URL.
The following vocabulary relating in the technical program refers to:
" picture library ": the picture that the picture storage device of local computer or search engine can grab in network.
" standard thumbnail ": the fixed measure thumbnail definitely according to search accuracy and file size balance.
" transition boundary line ": according to the accuracy of identification of single features variable, the mid point that numerical value change pixel line the occurs smooth curve forming that is linked in sequence.Because the pixel expression in current display technique causes transition boundary line not dropped on any pixel, when actual treatment, two curves that form with the pixel of both sides, transition boundary line calculate respectively.
Claims (4)
1. the image searching method based on visual signature, is characterized in that, comprising:
Transfer the picture in picture library to standard thumbnail according to setting physical dimension, then take the transition boundary line of each pixel form and aspect, saturation degree, brightness, gray scale, planimetric position, single features variable in standard thumbnail and transition boundary line thereon the tangential direction at every pixel place as characteristic variable forms full property data base associated with the URL (Uniform Resource Locator) of this picture;
Standard thumbnail, according to the accuracy of identification of setting, forms the transition boundary line of single features variable; And formed the single features spectral line of this picture by whole transition boundary lines;
When search, on the picture as sample file, the point arbitrarily of obtaining using computer entry device, continuous or discontinuous curve are as " search condition "; Common factor to " search condition " with transition boundary line, carries out single features variable or many characteristic variables combinatorial search according to its form and aspect, saturation degree, brightness, gray scale, planimetric position and transition boundary line in the tangential direction of this pixel;
Search result be returned as with " search condition " degree of agreement meet predefined picture with and URL.
2. method according to claim 1, wherein standard thumbnail refers to definite fixed measure thumbnail according to searching for order of accuarcy and file size balance.
3. method according to claim 1, full property data base comprises property data base, quadratic character database and three property data bases one time; Wherein, the form and aspect of the each pixel of standard thumbnail, saturation degree, brightness, gray scale and plane positional number value form a property data base; Standard thumbnail single features variable transition boundary line spectral line forms the quadratic character database of this characteristic variable; The direction of standard thumbnail single features variable transition boundary line tangent line of each pixel on transition boundary line forms three property data bases of this characteristic variable.
4. method according to claim 1, wherein " transition boundary line " refers to according to the accuracy of identification of single features variable, the pixel line mid point that numerical value change occurs is linked in sequence and forms smooth curve; Because the pixel expression in current display technique causes transition boundary line not dropped on any pixel, when actual treatment, two curves that form with the pixel of both sides, transition boundary line calculate respectively.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910107050.9A CN101556611B (en) | 2009-05-08 | 2009-05-08 | Image searching method based on visual features |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910107050.9A CN101556611B (en) | 2009-05-08 | 2009-05-08 | Image searching method based on visual features |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101556611A CN101556611A (en) | 2009-10-14 |
| CN101556611B true CN101556611B (en) | 2014-05-28 |
Family
ID=41174728
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910107050.9A Active CN101556611B (en) | 2009-05-08 | 2009-05-08 | Image searching method based on visual features |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101556611B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063472B (en) * | 2010-12-10 | 2012-08-22 | 北京大学 | Image searching method and system, client side and server |
| CN104361006A (en) * | 2014-10-11 | 2015-02-18 | 北京中搜网络技术股份有限公司 | Lightweight image search method |
| CZ306919B6 (en) * | 2015-12-18 | 2017-09-13 | Vysoké Učení Technické V Brně | A method of checking a person's colour of clothing and/or headgear |
| CN106294798B (en) * | 2016-08-15 | 2020-01-17 | 华为技术有限公司 | Image sharing method and terminal based on thumbnail |
| US10346727B2 (en) * | 2016-10-28 | 2019-07-09 | Adobe Inc. | Utilizing a digital canvas to conduct a spatial-semantic search for digital visual media |
| CN114757893A (en) * | 2018-10-29 | 2022-07-15 | 上海鹰瞳医疗科技有限公司 | Method and device for normalizing fundus images |
| CN110782025B (en) * | 2019-12-31 | 2020-04-14 | 长沙荣业智能制造有限公司 | Rice processing online process detection method |
| CN111209425A (en) * | 2020-01-06 | 2020-05-29 | 闻泰通讯股份有限公司 | Image searching method and device, electronic equipment and computer readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6026411A (en) * | 1997-11-06 | 2000-02-15 | International Business Machines Corporation | Method, apparatus, and computer program product for generating an image index and for internet searching and querying by image colors |
| CN1849601A (en) * | 2003-09-08 | 2006-10-18 | 皇家飞利浦电子股份有限公司 | Method and apparatus for indexing and searching graphic elements |
| CN101211341A (en) * | 2006-12-29 | 2008-07-02 | 上海芯盛电子科技有限公司 | Image intelligent mode recognition and searching method |
-
2009
- 2009-05-08 CN CN200910107050.9A patent/CN101556611B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6026411A (en) * | 1997-11-06 | 2000-02-15 | International Business Machines Corporation | Method, apparatus, and computer program product for generating an image index and for internet searching and querying by image colors |
| CN1849601A (en) * | 2003-09-08 | 2006-10-18 | 皇家飞利浦电子股份有限公司 | Method and apparatus for indexing and searching graphic elements |
| CN101211341A (en) * | 2006-12-29 | 2008-07-02 | 上海芯盛电子科技有限公司 | Image intelligent mode recognition and searching method |
Non-Patent Citations (1)
| Title |
|---|
| 张涛等.基于内容的图像检索技术.《广州大学学报(自然科学版)》.2004,第3卷(第5期),432-437. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101556611A (en) | 2009-10-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101556611B (en) | Image searching method based on visual features | |
| Afifi et al. | Image retrieval based on content using color feature | |
| Yue et al. | Content-based image retrieval using color and texture fused features | |
| TWI403912B (en) | Method and system of image retrieval | |
| Wang et al. | Robust image retrieval based on color histogram of local feature regions | |
| Dimitrovski et al. | Improving bag-of-visual-words image retrieval with predictive clustering trees | |
| Hurtut et al. | Adaptive image retrieval based on the spatial organization of colors | |
| Jing et al. | Canonical image selection from the web | |
| Celentano et al. | Feature integration and relevance feedback analysis in image similarity evaluation | |
| Bhardwaj et al. | Palette power: Enabling visual search through colors | |
| Han et al. | A shape-based image retrieval method using salient edges | |
| Khokher et al. | Content-based image retrieval: state-of-the-art and challenges | |
| Li et al. | A new algorithm for product image search based on salient edge characterization | |
| Premchaiswadi et al. | On-line content-based image retrieval system using joint querying and relevance feedback scheme | |
| AU2010282211B2 (en) | Method, system and controller for searching a database | |
| JP6445738B2 (en) | Similar image retrieval method and system | |
| Di Mascio et al. | VISTO: A new CBIR system for vector images | |
| Dimitrovski et al. | Fast and scalable image retrieval using predictive clustering trees | |
| Khokher et al. | Image retrieval: A state of the art approach for CBIR | |
| Munarko et al. | HII: Histogram Inverted Index for Fast Images Retrieval. | |
| Afifi | Image retrieval based on content using color feature | |
| Wang et al. | A new ROI based image retrieval system using an auxiliary Gaussian weighting scheme | |
| Gupta et al. | A new approach for cbir feedback based image classifier | |
| Niu et al. | M-SBIR: an improved sketch-based image retrieval method using visual word mapping | |
| Khokher et al. | Evaluation of a content-based image retrieval system using features based on colour means |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| DD01 | Delivery of document by public notice |
Addressee: Bai Qingshan Document name: Notification to Go Through Formalities of Registration |
|
| DD01 | Delivery of document by public notice |
Addressee: Bai Qingshan Document name: Notification that Entitlement to Patent Deemed Abandoned |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP02 | Change in the address of a patent holder |
Address after: 518067, Guangdong, Shenzhen province Nanshan District merchants Road North District 34, 102 Patentee after: Bai Qingshan Address before: 12, 9C, 518067, garden city, Nanhai Avenue, Shenzhen, Guangdong, Nanshan District Patentee before: Bai Qingshan |