CN101719140A - Figure retrieving method - Google Patents
Figure retrieving method Download PDFInfo
- Publication number
- CN101719140A CN101719140A CN200910214068A CN200910214068A CN101719140A CN 101719140 A CN101719140 A CN 101719140A CN 200910214068 A CN200910214068 A CN 200910214068A CN 200910214068 A CN200910214068 A CN 200910214068A CN 101719140 A CN101719140 A CN 101719140A
- Authority
- CN
- China
- Prior art keywords
- grid model
- dimensional grid
- dimensional
- reference mark
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000001228 spectrum Methods 0.000 claims abstract description 14
- 239000013598 vector Substances 0.000 claims description 28
- 238000000605 extraction Methods 0.000 claims description 22
- 239000011159 matrix material Substances 0.000 claims description 17
- 230000008569 process Effects 0.000 claims description 12
- 230000008676 import Effects 0.000 claims description 9
- 239000000284 extract Substances 0.000 claims description 8
- 230000000750 progressive effect Effects 0.000 claims description 6
- 210000003954 umbilical cord Anatomy 0.000 claims description 6
- 230000001174 ascending effect Effects 0.000 claims description 4
- 238000013507 mapping Methods 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000000354 decomposition reaction Methods 0.000 claims description 3
- 239000000203 mixture Substances 0.000 claims description 2
- 238000010168 coupling process Methods 0.000 description 9
- 230000008878 coupling Effects 0.000 description 8
- 238000005859 coupling reaction Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 230000000875 corresponding effect Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000000052 comparative effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 230000002068 genetic effect Effects 0.000 description 1
- 238000002386 leaching Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000010008 shearing Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a figure retrieving method, comprising the steps of: (1) modeling a polygon; establishing a three-dimensional grid model base; (2) matching three-dimensional grid models with two-dimensional images or figures; (3) extracting frameworks of the three-dimensional grid models; (4) retrieving the three-dimensional models according to the frameworks; (5) extracting characteristic points of the three-dimensional grid models; (6) computing control points of the three-dimensional grid models; (7) computing frequency spectra of the control points of the three-dimensional grid models; and (8) computing the similarity of the frequency spectra and retrieving a corresponding figure according to the similarity. The technical scheme is more convenient for retrieval and supports multimode retrieval.
Description
Technical field
The present invention relates to the graph processing technique field, be specifically related to a kind of figure retrieving method.
Background technology
Network and computer graphics are infiltrated in the daily life gradually, and people no longer are satisfied with can only see two dimensional image on network.On the other hand, along with the develop rapidly of the increasingly mature and computer hardware technique of dimensional Modeling Technology, the quantity of three-dimensional model has had tremendous growth in nearest 10 years.With respect to two dimensional image, people can browse own part interested from arbitrarily angled, so more are subjected to the people to like that purposes is more extensive.Online game and animation technology, Web education technology, all can not lack these medium of three-dimensional picture based on the information service gordian technique of Web and the research of product and hot fields such as database and data mining technology.
Make full use of existing three-dimensional modeling data resource, can alleviate the workload of design new model greatly, also can promote simultaneously the circulation of three-dimensional data and in the application in each field.Yet, how in the 3 d model library of magnanimity, to search own interested model fast, for 3 d model library is set up the problem that search engine is a difficulty.The figure retrieving method of prior art is according to how much contents three-dimensional model to be carried out systematic searching, and the user can not pass through the search interface retrieval request expression easily.
Summary of the invention
The technical problem to be solved in the present invention provides a kind of figure retrieving method, can overcome the deficiencies in the prior art, realize the multi-modal retrieval of figure, make that retrieval is more convenient, improve present multimedia search technology and the blank of filling up present network three-dimensional picture search engine, promote the realization of intelligent multi-modal search engine of future generation.
Technical scheme provided by the invention is as follows:
The invention provides a kind of figure retrieving method, comprising:
1) sets up the three-dimensional grid model storehouse;
2) when user input be X-Y scheme or image the time, mate with the profile of three-dimensional grid model in the three-dimensional grid model storehouse, according to matching parameter three-dimensional grid model is projected to two-dimensional space, obtain the two dimensional image or the figure of projection, calculate two dimensional image or the figure of figure and input or the degree of correlation between the image that projection obtains then, retrieval obtains three-dimensional grid model according to the degree of correlation;
3) when user input be three-dimensional grid model the time, the three-dimensional grid model of input is carried out skeletal extraction, according to the three-dimensional grid model skeleton that extracts, preliminary search obtains three-dimensional grid model in the three-dimensional grid model storehouse;
4) three-dimensional grid model of three-dimensional grid model that retrieval is obtained and user input carries out feature point extraction, replace original three-dimensional grid model, carry out triangulation again, cut-off rule behind the subdivision is carried out piecewise fitting, obtain the reference mark of original three-dimensional grid model, according to topological structure frequency domain transform is carried out at the reference mark then;
5) user who calculates imports the similarity between the reference mark frequency domain coordinate figure of the reference mark frequency domain coordinate figure of three-dimensional grid model and the three-dimensional grid model in the three-dimensional grid model storehouse, goes out graph of a correspondence according to similarity retrieval.
Preferably, the three-dimensional grid model storehouse in the step 1) to various three-dimensional data forms reorganize with the polygon modeling after obtain.
Preferably, the skeletal extraction process is: at first set up progressive grid representation for the grid model of input, then progressive grid is constantly carried out the limit conversion of collapsing, if a limit does not have adjacent triangle in the process of collapsing, then this limit is labeled as the skeleton limit, and remain into the end of collapsing, the skeleton of the final limit component model that obtains always.
Preferably, the three-dimensional grid model of the three-dimensional grid model that obtains for retrieval in the step 4) and user's input carries out feature point extraction according to its spatial form, replaces original three-dimensional grid model with umbilical cord point as unique point.
Preferably, according to unique point three-dimensional grid model is carried out triangulation in the step 4), the cut-off rule behind the subdivision is carried out piecewise fitting, obtain cut-point, with the reference mark of these cut-points as original three-dimensional grid model.
Preferably, the topological structure according to three-dimensional grid model in the step 4) carries out frequency domain transform to the reference mark that obtains, and comprising:
(1) with the mould of reference mark sorted in the reference mark of coarse grids to the vector of grid element center;
(2) obtain the Kirchhoff matrix from the network topology relation
K＝D-A (6)
D is a diagonal matrix, and the element Dii on its diagonal line is corresponding with the valency of vertex v i, and A is the adjacency matrix of grid;
The Kirchhoff matrix is carried out n the proper vector w that characteristic value decomposition obtains
iCarry out ascending order and arrange the n*n mapping matrix W of composition;
(3) 3 vectors of the volume coordinate at before preceding sorted n reference mark structure:
X＝(x
1，x
2，…，x
n)，Y＝(y
1，y
2，…，y
n)，Z＝(z
1，z
2，…，z
n) (8)
These 3 vector projections are obtained frequency domain vector to the proper vector base W:
The amplitude S of the frequency spectrum of each summit correspondence
iComputing formula is:
The present invention has following beneficial effect:
(1) can be according to single two dimensional image retrieval three-dimensional picture, the user can import the picture of common forms such as bmp, jpeg, tiff, can retrieve graph of a correspondence by the inventive method.
(2) method for expressing of the three-dimensional model of support input is more extensive, all is suitable for for triangular mesh data, cloud data, volume data or polygonal grid model.
(3) adopted hierarchical search, faster more accurate.At first the skeleton according to three-dimensional picture carries out coarse search, adopts the further feature extractive technique accurately to search for to the three-dimensional picture in the Search Results, has guaranteed real-time and accuracy.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, to do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below, apparently, accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is that the user imports X-Y scheme or treatment of picture synoptic diagram;
Fig. 2 is a coupling process flow diagram three-dimensional and two dimension;
Fig. 3 is the processing flow chart when importing the 3D grid data for the user.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making all other embodiment that obtained under the creative work prerequisite.
The inventive method is mainly studied the multi-modal retrieval of figure, its principle is the feature according to three-dimensional picture, by information such as two dimensional image, X-Y scheme, three-dimensional models, calculate the figure of user's input or the similarity between image and the three-dimensional picture, thereby realize the multi-modal retrieval of three-dimensional picture.Here multi-modal being meant supports that the user inquires about with two dimensional image, X-Y scheme and the three-dimensional model of common form.
Aspect of the present invention extracts very little data volume from three-dimensional data, and with its principal character as corresponding figure or image, can retrieve according to this principal character.This feature is not subjected to the influence of factors such as noise, similarity transformation, different resolution sampling substantially.
The inventive method mainly comprises following 8 links:
(1) at first the three-dimensional modeling data of various data layouts is reorganized, carry out the polygon modeling, obtain three-dimensional grid model, and set up the three-dimensional grid model storehouse.
(2) when user input be X-Y scheme or image the time, mate with the profile of three-dimensional grid model in the three-dimensional grid model storehouse, according to matching parameter three-dimensional grid model is projected to two-dimensional space then, obtain the two dimensional image or the figure of projection, calculate two dimensional image or the figure of figure and input or the degree of correlation between the image that projection obtains then, retrieve three-dimensional grid model according to the degree of correlation.
(3) when user input be three-dimensional grid model the time, the three-dimensional grid model of input is carried out skeletal extraction.
(4) according to the three-dimensional grid model skeleton that extracts, in the three-dimensional grid model storehouse, carry out preliminary search fast, obtain the three-dimensional grid model that preliminary search goes out.
(5) three-dimensional grid model that preliminary search is gone out according to the graphics theory and the three-dimensional grid model of user's input carry out feature point extraction according to its spatial form, replace original three-dimensional grid model, significantly reduce data volume.
(6) according to the unique point of extracting three-dimensional grid model is carried out triangulation, the cut-off rule behind the subdivision is carried out piecewise fitting, obtain cut-point, the reference mark of these cut-points as original three-dimensional grid model.
(7) topological structure according to three-dimensional grid model carries out frequency domain transform to the reference mark, the frequency domain coordinate figure of controlled point.
(8) user who calculates imports the similarity between the reference mark frequency domain coordinate figure of the reference mark frequency domain coordinate figure of three-dimensional grid model and the three-dimensional grid model in the three-dimensional grid model storehouse, goes out graph of a correspondence according to similarity retrieval.
Technical characterstic of the present invention mainly embodies as follows:
(1) system can be according to single two dimensional image retrieval three-dimensional picture.The user can import the picture of common forms such as bmp, jpeg, tiff, system will be from picture cutting object and extract profile information, mate with the three-dimensional picture in the three-dimensional grid model storehouse, return the three-dimensional grid model of coupling to the user.
(2) method for expressing of the three-dimensional model of system's support input is more extensive.Triangular mesh data, cloud data, volume data or polygonal grid model all are suitable for.
(3) system adopts hierarchical search.At first the skeleton according to three-dimensional picture carries out coarse search, adopts Feature Extraction Technology accurately to search for again to the three-dimensional picture in the Search Results, has guaranteed real-time and accuracy.
Below the present invention is described in further details.
The present invention supports multi-modal figure retrieving method key step to comprise:
(1) carries out the polygon modeling, set up the three-dimensional grid model storehouse in advance;
(2) coupling of three-dimensional grid model and two dimensional image or figure;
(3) extraction of three-dimensional grid model skeleton;
(4) carry out three-dimensional model search according to skeleton;
(5) three-dimensional grid model feature point extraction;
(6) calculating at three-dimensional grid model reference mark;
(7) calculating of three-dimensional grid model reference mark frequency spectrum;
(8) calculate the frequency spectrum similarity, go out graph of a correspondence according to similarity retrieval.
Below respectively above-mentioned steps is described in detail.
(1) carries out the polygon modeling, set up the three-dimensional grid model storehouse in advance.
The present invention carries out the polygon modeling according to the three-dimensional grid model data, structure polygon three-dimensional grid model.The polygon modeling is to utilize many polygon simulation curved surfaces to carry out, and polygon is many more, and then model approaches true curved surface more.The polygon modeling is the most extensive a kind of modeling technique realized of being easy to again, and can obtain high-precision model, adopts the network of triangle case form usually.
For the convenience and the unification of following description, utilize mathematic sign to provide the definition of three-dimensional grid model.Grid model M={V, C} is made up of vertex set V and annexation set C, wherein gathers V and comprises N vertex v
iAnd the coordinate figure on each summit is by (x
i, y
i, z
i) determine, promptly
V＝{v
i}，i＝0，1，…，N-1，v
i＝(x
i，y
i，z
i) (1)
And annexation set C is expressed as
C＝{{i
k，j
k}}
k＝0，…m-1，0#i
k?N-1，0#j
k?N-1 (2)
Here { i
k, j
kRepresent by i
kIndividual summit and j
kThe k bar limit that individual summit is determined.
(2) coupling of three-dimensional grid model and two dimensional image or figure
Fig. 1 is that the user imports X-Y scheme or treatment of picture synoptic diagram.
As shown in Figure 1,, carry out outline, carry out the 2D projection again, carry out figure coupling relatedness computation then with the model bank figure for single image/figure.
Under many circumstances, user's retrieval is input as two dimensional image or figure, with the coupling detailed process of three-dimensional grid model as shown in Figure 2.At first, the present invention adopts the profile (or graph outline) of image and the three-dimensional grid model profile in the three-dimensional grid model storehouse to carry out initial matching earlier; After the outline, the three-dimensional grid model that obtains is projected to the 2D space according to matching parameter, obtain projected image, carry out further accurately coupling with image relevant matches method then.
The profile that all grid models in the three-dimensional grid model storehouse have been finished X, Y, three positive dirctions of Z extracts and projection calculating.
For three-dimensional grid model, the inventive method is the profile that extract on each limit in the traversal grid, and concrete grammar is as follows:
1. if only be connected with a triangle when the front, it belongs to profile so;
2. if as front and two triangle F
1And F
2, then define its normal vector and be respectively
With
, current lens location and the vector of working as between the summit in front are
If
Promptly
With
Axle with respect to camera lens is in different directions, and F is described
1And F
2One face mirror first back to camera lens, therefore when the front be silhouette edge, otherwise, when the front is not significant silhouette edge.
For figure, do not need the profile leaching process.
For image, can adopt operator extraction profiles such as Sobel, Prewitt.
Outline process of the present invention can adopt based on the correspondingly-shaped matching process, as the Hausdoff distance; Perhaps polygon decomposes matching process, as carry out the line segment processing, and with the profile center of gravity is that triangulation is carried out at the center, determine border vertices, couple together and just become a convex polygon, with the former figure of this convex polygon approximate representation,, carry out the graph outline coupling thereby form a series of triangles with polygon center of gravity and summit line.The outline process is simply efficient, can realize initial retrieval fast.
Image relevant matches method of the present invention is to calculate two dimensional image or the figure of figure and input or the degree of correlation between the image that the three-dimensional grid model projection obtains, as utilizes each similarity to pixel in the normalization correlated measure computed image zone.For two width of cloth image I to be matched
1(x, y) and I
2(x, y), mapping to be checked position (i, j) go up the normalization correlated measure and be defined as:
When the degree of correlation greater than a setting threshold, promptly retrieve the three-dimensional grid model of coupling.
(3) extraction of three-dimensional grid model skeleton
Skeleton is the good descriptive geometry feature of a kind of character, claims axis (Medial Axis) again, is a kind of effective pattern description means.As its name suggests, skeleton is a kind of solid of line style, occupy the symcenter of figure, and the topological structure identical with former figure arranged, and is keeping the shape information of former figure.
Fig. 3 is the processing flow chart when importing the 3D grid data for the user.
The process of Fig. 3 comprises following process, i.e. the extraction of (3) three-dimensional grid model skeleton; (4) carry out three-dimensional model search according to skeleton; (5) three-dimensional grid model feature point extraction; (6) calculating at three-dimensional grid model reference mark; (7) calculating of three-dimensional grid model reference mark frequency spectrum; (8) calculate the frequency spectrum similarity, go out graph of a correspondence according to similarity retrieval.Description below particular content is participated in.
The present invention has designed a kind of fast based on the skeletal extraction algorithm of multi-resolution grid: at first set up progressive grid representation for three-dimensional grid model, then progressive grid is constantly carried out the limit conversion of collapsing, if a limit does not have adjacent triangle in the process of collapsing, this edge is labeled as the skeleton limit so, and remain into the end of collapsing, the final limit that obtains has just constituted the skeleton of grid model always.All grid models in the three-dimensional grid model storehouse have been finished skeletal extraction and have been calculated.When importing grid model, the user need extract skeleton.
(4) carry out three-dimensional model search according to skeleton
Extracting skeleton is the process that the 3D figure is converted to the 3D line segment, and the data volume of 3D line segment significantly reduces with respect to original 3D figure, therefore can accelerate retrieval rate.
The three-dimensional grid model of user's input and the grid model in the storehouse carry out skeleton relatively, relatively skeleton adopts major component PCA analytic approach, earlier skeleton is located, the distance of skeleton is calculated in segmentation, directly adopt Euclidean distance to sort then, according to the range information comparative result, the three-dimensional grid model that is preliminary search of Euclidean distance difference minimum.
(5) three-dimensional grid model feature point extraction
According to the three-dimensional grid model of graphics theory with user's input, carry out feature point extraction according to its spatial form, replace original three-dimensional grid model, significantly reduce data volume.All grid models in the three-dimensional grid model storehouse have been finished feature point extraction, the reference mark frequency spectrum calculates.
The present invention uses the unique point of umbilical cord point as the arbitrary triangle three-dimensional grid model.With the unique point of umbilical cord point as the three-dimensional grid model surface, for noise, shearing, rotation, translation, convergent-divergent, different resolution sampling etc. because the influence that causes of different acquisition equipment has very strong robustness.Owing to the curvature on the limit that strides across grid model is bigger, so curvature tensor can be defined as each point on the limit of grid model.In any net region B, the curvature tensor of fixed point v can be estimated with following formula:
Wherein, | B| is the area of the neighborhood of v, and β (e) is the angle between two leg-of-mutton normal vectors of adjacency of limit e, | e ∩ B| is the length of the limit e in the area B, and e is the unit normal vector along limit e.The neighboring region B of v is by being the centre of sphere with v, is that the spheroid of radius and the crossing circle of grid model define with r.Radius r is the scale parameter of specifying Curvature Estimation.
Obtain after the curvature tensor on each summit, in the enterprising line linearity interpolation of each triangular mesh to obtain continuous curvature tensor field.The normal vector direction on summit is corresponding with the eigenwert of the amplitude minimum of curvature tensor, other two eigenwerts are minimum curvature and the maximum curvature of corresponding vertex v respectively, when these two eigenwerts equated, vertex v was called as umbilical cord point, the i.e. unique point of the three-dimensional grid model that uses among the present invention.
Obviously the key of Curvature Estimation is a scale parameter.The present invention adopts different yardsticks to carry out the curvature tensor estimation, so that the umbilical cord point under level and smooth tensor field and the estimation different scale is for the robustness of factors such as noise and affined transformation.For fear of the local message of losing the grid model surface and reduce computation complexity, scale parameter can not be obtained excessive.The present invention selects for use self-adapted genetic algorithm as the optimization searching technology when seeking the highest scale parameter of robustness.In the highest several scales parameter of robustness, we select the point that makes the mean curvature maximum in the area B, the i.e. point of the mark maximum of curvature tensor for use.
(6) calculating at three-dimensional grid model reference mark
According to the unique point of extracting three-dimensional grid model is carried out triangulation, the cut-off rule behind the subdivision is carried out piecewise fitting, obtain cut-point, the reference mark of these cut-points as original three-dimensional grid model.
Obtain after the unique point, next step task is to reduce data volume, and this retrieval for feature registration and three-dimensional grid model is all extremely important.
Obtain after the unique point, the first step is grid to be carried out triangle cut apart.In the 2D space, the Delaunay triangle is cut apart can produce shape triangle uniformly, and has uniqueness.In the 3D surface, the Delaunay triangle is cut apart and is not to use Euclidean distance and is to use geodesic distance (geodesic distance is meant two summit bee-lines surfacewise of surface mesh in the 3d space).The present invention adopts the wave front method that whole Voronoi figure and double Delaunay triangle thereof are cut apart to estimate.The benefit that adopts this method is to make triangle cut apart the influence of the size that is not subjected to sampling rate.Wave front is to be the centre of sphere by calculating with the seed points, the crossing circle acquisition on the ever-increasing ball of radius and 3D grid surface.Employing is better than the result that the wave front method that adopts based on the network topology relation obtains based on the wave front method of the different radiuses of a ball.
(7) calculating of three-dimensional grid model reference mark frequency spectrum
Topological structure according to three-dimensional grid model carries out frequency domain transform to the reference mark, the frequency domain coordinate figure of controlled point.
Because the 3D grid is a figure and non-image,, therefore the 3D grid is carried out transform domain and handle and at first will construct an image function, so that the transform domain Processing Algorithm of classics is applied to the 3D Mesh Processing so each apex coordinate does not have its intrinsic image function.
At first, sorted in the reference mark.The present invention sorts to the reference mark of coarse grids with the mould of reference mark to the vector of grid element center.
The coordinate of definition grid element center is
Each reference mark is defined as follows to the mould of the vector of grid element center
The reference mark is carried out beginning to carry out frequency domain transform after ascending order arranges according to the mould size.At first from the network topology relation, obtain the combination Laplace operator or be called the Kirchhoff matrix.This defined matrix is as follows:
K＝D-A (6)
Wherein, D is a diagonal matrix, the element Dii on its diagonal line corresponding with the valency of vertex v i (valency promptly is the number on the limit of radiating from the summit), and A is the adjacency matrix of grid, its element definition is as follows:
For the grid model that n reference mark arranged, the size of matrix A, D and K is n*n.The Kirchhoff matrix is carried out characteristic value decomposition obtain n eigenvalue
iWith n proper vector w
iThis n proper vector is carried out ascending order arrange, can obtain its characteristic of correspondence vector, the proper vector after these orderings is the function base that frequency constantly increases.This function base only depends on the topological structure of grid model, and irrelevant with the geometrical property of grid model.The n*n mapping matrix note that proper vector after this n the ordering is formed is W.
3 vectors of the volume coordinate at sorted n reference mark structure before before:
X＝(x
1，x
2，…，x
n)，Y＝(y
1，y
2，…，y
n)，Z＝(z
1，z
2，…，z
n) (8)
These 3 vector projections to proper vector base W, can be obtained the frequency domain branch solution vector of spatial domain coordinate:
Volume coordinate also can be obtained by the frequency coordinate reduction:
The amplitude S of the frequency spectrum of each summit correspondence
iCan calculate by following formula:
(8) calculate the frequency spectrum similarity, go out graph of a correspondence according to similarity retrieval.
The degree of correlation between the reference mark frequency domain coordinate figure of the three-dimensional grid model of calculating user input and the reference mark frequency domain coordinate figure of the three-dimensional grid model in the storehouse retrieves graph of a correspondence according to the degree of correlation.
When comparing the similarity of two grid models, then judge by the wave-form similarity that compares frequency coefficient.Criterion when comparing similarity can adopt normalized correlation coefficient:
Wherein
The spectrum value that calculates for three-dimensional grid model by user input,
Be the 3D grid spectrum value in the storehouse.NC is big more, and then spectral coefficient is relevant more.
A given threshold value T, if NC＞T thinks that then 3D grid that the user imports and the 3D grid in the storehouse are complementary, retrieval flow finishes.
The present invention has following beneficial effect:
(1) can be according to single two dimensional image retrieval three-dimensional picture, the user can import the picture of common forms such as bmp, jpeg, tiff, can retrieve graph of a correspondence by the inventive method.
(2) method for expressing of the three-dimensional model of support input is more extensive, all is suitable for for triangular mesh data, cloud data, volume data or polygonal grid model.
(3) adopted hierarchical search, faster more accurate.At first the skeleton according to three-dimensional picture carries out coarse search, adopts the further feature extractive technique accurately to search for to the three-dimensional picture in the Search Results, has guaranteed real-time and accuracy.
One of ordinary skill in the art will appreciate that all or part of step in the whole bag of tricks of the foregoing description is to instruct relevant hardware to finish by program, this program can be stored in the computer-readable recording medium, storage medium can comprise: ROM (read-only memory) (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), disk or CD etc.
More than to a kind of figure retrieving method that the embodiment of the invention provided, be described in detail, used specific case herein principle of the present invention and embodiment are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, the part that all can change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (6)
1. a figure retrieving method is characterized in that, comprising:
1) sets up the three-dimensional grid model storehouse;
2) when user input be X-Y scheme or image the time, mate with the profile of three-dimensional grid model in the three-dimensional grid model storehouse, according to matching parameter three-dimensional grid model is projected to two-dimensional space, obtain the two dimensional image or the figure of projection, calculate two dimensional image or the figure of figure and input or the degree of correlation between the image that projection obtains then, retrieval obtains three-dimensional grid model according to the degree of correlation;
3) when user input be three-dimensional grid model the time, the three-dimensional grid model of input is carried out skeletal extraction, according to the three-dimensional grid model skeleton that extracts, preliminary search obtains three-dimensional grid model in the three-dimensional grid model storehouse;
4) three-dimensional grid model of three-dimensional grid model that retrieval is obtained and user input carries out feature point extraction, replace original three-dimensional grid model, carry out triangulation again, cut-off rule behind the subdivision is carried out piecewise fitting, obtain the reference mark of original three-dimensional grid model, according to topological structure frequency domain transform is carried out at the reference mark then;
5) user who calculates imports the similarity between the reference mark frequency domain coordinate figure of the reference mark frequency domain coordinate figure of three-dimensional grid model and the three-dimensional grid model in the three-dimensional grid model storehouse, goes out graph of a correspondence according to similarity retrieval.
2. figure retrieving method according to claim 1 is characterized in that:
Three-dimensional grid model storehouse in the step 1) to various three-dimensional data forms reorganize with the polygon modeling after obtain.
3. figure retrieving method according to claim 1 and 2 is characterized in that:
The skeletal extraction process is: at first set up progressive grid representation for the grid model of input, then progressive grid is constantly carried out the limit conversion of collapsing, if a limit does not have adjacent triangle in the process of collapsing, then this limit is labeled as the skeleton limit, and remain into the end of collapsing, the skeleton of the final limit component model that obtains always.
4. figure retrieving method according to claim 1 and 2 is characterized in that:
The three-dimensional grid model of the three-dimensional grid model that obtains for retrieval in the step 4) and user's input carries out feature point extraction according to its spatial form, replaces original three-dimensional grid model with umbilical cord point as unique point.
5. figure retrieving method according to claim 1 and 2 is characterized in that:
According to unique point three-dimensional grid model is carried out triangulation in the step 4), the cut-off rule behind the subdivision is carried out piecewise fitting, obtain cut-point, with the reference mark of these cut-points as original three-dimensional grid model.
6. figure retrieving method according to claim 1 and 2 is characterized in that:
Topological structure according to three-dimensional grid model in the step 4) carries out frequency domain transform to the reference mark that obtains, and comprising:
(1) with the mould of reference mark sorted in the reference mark of coarse grids to the vector of grid element center;
(2) obtain the Kirchhoff matrix from the network topology relation
K＝D-A (6)
D is a diagonal matrix, and the element Dii on its diagonal line is corresponding with the valency of vertex v i, and A is the adjacency matrix of grid;
The Kirchhoff matrix is carried out n the proper vector w that characteristic value decomposition obtains
iCarry out ascending order and arrange the n*n mapping matrix W of composition;
(3) 3 vectors of the volume coordinate at before preceding sorted n reference mark structure:
X＝(x
1，x
2，…，x
n)，Y＝(y
1，y
2，…，y
n)，Z＝(z
1，z
2，…，z
n) (8)
These 3 vector projections are obtained frequency domain vector to the proper vector base W:
The amplitude S of the frequency spectrum of each summit correspondence
iComputing formula is:
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009102140689A CN101719140B (en) | 2009-12-23 | 2009-12-23 | Figure retrieving method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009102140689A CN101719140B (en) | 2009-12-23 | 2009-12-23 | Figure retrieving method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101719140A true CN101719140A (en) | 2010-06-02 |
| CN101719140B CN101719140B (en) | 2012-04-18 |
Family
ID=42433714
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009102140689A Expired - Fee Related CN101719140B (en) | 2009-12-23 | 2009-12-23 | Figure retrieving method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101719140B (en) |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101957992A (en) * | 2010-09-30 | 2011-01-26 | 清华大学 | Two-dimensional injective mapping curve data characteristic extracting and matching method |
| CN102004922A (en) * | 2010-12-01 | 2011-04-06 | 南京大学 | High-resolution remote sensing image plane extraction method based on skeleton characteristic |
| CN102063475A (en) * | 2010-12-22 | 2011-05-18 | 张丛喆 | Webpage user terminal presenting method of three-dimensional model |
| CN102375831A (en) * | 2010-08-13 | 2012-03-14 | 富士通株式会社 | Three-dimensional model search device and method thereof and model base generation device and method thereof |
| CN102402288A (en) * | 2010-09-07 | 2012-04-04 | 微软公司 | System for fast, probabilistic skeletal tracking |
| CN103309938A (en) * | 2013-04-24 | 2013-09-18 | 中国科学院遥感与数字地球研究所 | Method for realizing high-performance of polygonal maximum inner circle |
| CN103412947A (en) * | 2013-08-26 | 2013-11-27 | 浙江大学 | Polygon search method for big space data |
| CN103544734A (en) * | 2013-10-11 | 2014-01-29 | 深圳先进技术研究院 | Street vie based three-dimensional map modeling method |
| CN104503275A (en) * | 2014-11-21 | 2015-04-08 | 深圳市超节点网络科技有限公司 | Non-contact control method and equipment based on gestures |
| CN104714986A (en) * | 2013-12-12 | 2015-06-17 | 三纬国际立体列印科技股份有限公司 | Three-dimensional picture searching method and three-dimensional picture searching system |
| CN105354866A (en) * | 2015-10-21 | 2016-02-24 | 郑州航空工业管理学院 | Polygon contour similarity detection method |
| CN106445981A (en) * | 2016-02-15 | 2017-02-22 | 哈尔滨理工大学 | Wavelet transform-based self-adaptive compression method for STL (Standard Template Library) grid model slicing data |
| WO2017107865A1 (en) * | 2015-12-22 | 2017-06-29 | 成都理想境界科技有限公司 | Image retrieval system, server, database, and related method |
| WO2017107866A1 (en) * | 2015-12-22 | 2017-06-29 | 成都理想境界科技有限公司 | Image retrieval server and system, related retrieval and troubleshooting method |
| CN107316343A (en) * | 2016-04-26 | 2017-11-03 | 腾讯科技（深圳）有限公司 | A kind of model treatment method and apparatus based on data-driven |
| CN108596186A (en) * | 2018-03-19 | 2018-09-28 | 西北大学 | A kind of method for searching three-dimension model |
| CN108898128A (en) * | 2018-07-11 | 2018-11-27 | 宁波艾腾湃智能科技有限公司 | A kind of method for anti-counterfeit and equipment matching digital three-dimemsional model by photo |
| CN109034418A (en) * | 2018-07-26 | 2018-12-18 | 国家电网公司 | Operation field information transferring method and system |
| CN109299301A (en) * | 2018-09-17 | 2019-02-01 | 北京工业大学 | A kind of method for searching three-dimension model based on distribution of shapes and curvature |
| CN109359534A (en) * | 2018-09-12 | 2019-02-19 | 鲁东大学 | A kind of three-dimension object Extraction of Geometrical Features method and system |
| CN109816771A (en) * | 2018-11-30 | 2019-05-28 | 西北大学 | A kind of automatic recombination method of cultural relic fragments of binding characteristic point topology and geometrical constraint |
| CN110019914A (en) * | 2018-07-18 | 2019-07-16 | 王斌 | A kind of three-dimensional modeling data storehouse search method for supporting three-dimensional scenic interaction |
| CN111189440A (en) * | 2019-12-31 | 2020-05-22 | 中国电建集团华东勘测设计研究院有限公司 | Positioning navigation method based on comparison of spatial information model and real-time image |
| CN111643906A (en) * | 2020-05-29 | 2020-09-11 | 腾讯科技（深圳）有限公司 | Information processing method and device and computer readable storage medium |
| CN112270762A (en) * | 2020-11-18 | 2021-01-26 | 天津大学 | Three-dimensional model retrieval method based on multi-mode fusion |
| CN112732956A (en) * | 2020-12-24 | 2021-04-30 | 江苏智水智能科技有限责任公司 | Efficient query method based on perception multi-mode big data |
-
2009
- 2009-12-23 CN CN2009102140689A patent/CN101719140B/en not_active Expired - Fee Related
Cited By (38)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102375831A (en) * | 2010-08-13 | 2012-03-14 | 富士通株式会社 | Three-dimensional model search device and method thereof and model base generation device and method thereof |
| CN102375831B (en) * | 2010-08-13 | 2014-09-10 | 富士通株式会社 | Three-dimensional model search device and method thereof and model base generation device and method thereof |
| CN102402288A (en) * | 2010-09-07 | 2012-04-04 | 微软公司 | System for fast, probabilistic skeletal tracking |
| CN101957992A (en) * | 2010-09-30 | 2011-01-26 | 清华大学 | Two-dimensional injective mapping curve data characteristic extracting and matching method |
| CN102004922A (en) * | 2010-12-01 | 2011-04-06 | 南京大学 | High-resolution remote sensing image plane extraction method based on skeleton characteristic |
| CN102004922B (en) * | 2010-12-01 | 2012-12-26 | 南京大学 | High-resolution remote sensing image plane extraction method based on skeleton characteristic |
| CN102063475A (en) * | 2010-12-22 | 2011-05-18 | 张丛喆 | Webpage user terminal presenting method of three-dimensional model |
| CN102063475B (en) * | 2010-12-22 | 2012-10-10 | 张丛喆 | Webpage user terminal presenting method of three-dimensional model |
| CN103309938A (en) * | 2013-04-24 | 2013-09-18 | 中国科学院遥感与数字地球研究所 | Method for realizing high-performance of polygonal maximum inner circle |
| CN103412947A (en) * | 2013-08-26 | 2013-11-27 | 浙江大学 | Polygon search method for big space data |
| CN103544734A (en) * | 2013-10-11 | 2014-01-29 | 深圳先进技术研究院 | Street vie based three-dimensional map modeling method |
| US9817845B2 (en) | 2013-12-12 | 2017-11-14 | Xyzprinting, Inc. | Three-dimensional image file searching method and three-dimensional image file searching system |
| CN104714986A (en) * | 2013-12-12 | 2015-06-17 | 三纬国际立体列印科技股份有限公司 | Three-dimensional picture searching method and three-dimensional picture searching system |
| CN104503275A (en) * | 2014-11-21 | 2015-04-08 | 深圳市超节点网络科技有限公司 | Non-contact control method and equipment based on gestures |
| CN105354866B (en) * | 2015-10-21 | 2018-11-06 | 郑州航空工业管理学院 | A kind of polygonal profile similarity detection method |
| CN105354866A (en) * | 2015-10-21 | 2016-02-24 | 郑州航空工业管理学院 | Polygon contour similarity detection method |
| WO2017107865A1 (en) * | 2015-12-22 | 2017-06-29 | 成都理想境界科技有限公司 | Image retrieval system, server, database, and related method |
| WO2017107866A1 (en) * | 2015-12-22 | 2017-06-29 | 成都理想境界科技有限公司 | Image retrieval server and system, related retrieval and troubleshooting method |
| CN106445981A (en) * | 2016-02-15 | 2017-02-22 | 哈尔滨理工大学 | Wavelet transform-based self-adaptive compression method for STL (Standard Template Library) grid model slicing data |
| CN106445981B (en) * | 2016-02-15 | 2020-03-27 | 哈尔滨理工大学 | STL grid model slice data adaptive compression method based on wavelet transformation |
| CN107316343B (en) * | 2016-04-26 | 2020-04-07 | 腾讯科技（深圳）有限公司 | Model processing method and device based on data driving |
| CN107316343A (en) * | 2016-04-26 | 2017-11-03 | 腾讯科技（深圳）有限公司 | A kind of model treatment method and apparatus based on data-driven |
| CN108596186A (en) * | 2018-03-19 | 2018-09-28 | 西北大学 | A kind of method for searching three-dimension model |
| CN108596186B (en) * | 2018-03-19 | 2021-06-22 | 西北大学 | Three-dimensional model retrieval method |
| CN108898128A (en) * | 2018-07-11 | 2018-11-27 | 宁波艾腾湃智能科技有限公司 | A kind of method for anti-counterfeit and equipment matching digital three-dimemsional model by photo |
| CN110019914B (en) * | 2018-07-18 | 2023-06-30 | 王斌 | Three-dimensional model database retrieval method supporting three-dimensional scene interaction |
| CN110019914A (en) * | 2018-07-18 | 2019-07-16 | 王斌 | A kind of three-dimensional modeling data storehouse search method for supporting three-dimensional scenic interaction |
| CN109034418A (en) * | 2018-07-26 | 2018-12-18 | 国家电网公司 | Operation field information transferring method and system |
| CN109359534A (en) * | 2018-09-12 | 2019-02-19 | 鲁东大学 | A kind of three-dimension object Extraction of Geometrical Features method and system |
| CN109299301B (en) * | 2018-09-17 | 2021-09-14 | 北京工业大学 | Three-dimensional model retrieval method based on shape distribution and curvature |
| CN109299301A (en) * | 2018-09-17 | 2019-02-01 | 北京工业大学 | A kind of method for searching three-dimension model based on distribution of shapes and curvature |
| CN109816771A (en) * | 2018-11-30 | 2019-05-28 | 西北大学 | A kind of automatic recombination method of cultural relic fragments of binding characteristic point topology and geometrical constraint |
| CN109816771B (en) * | 2018-11-30 | 2022-11-22 | 西北大学 | Cultural relic fragment automatic recombination method combining feature point topology and geometric constraint |
| CN111189440A (en) * | 2019-12-31 | 2020-05-22 | 中国电建集团华东勘测设计研究院有限公司 | Positioning navigation method based on comparison of spatial information model and real-time image |
| CN111643906A (en) * | 2020-05-29 | 2020-09-11 | 腾讯科技（深圳）有限公司 | Information processing method and device and computer readable storage medium |
| CN111643906B (en) * | 2020-05-29 | 2021-08-31 | 腾讯科技（深圳）有限公司 | Information processing method and device and computer readable storage medium |
| CN112270762A (en) * | 2020-11-18 | 2021-01-26 | 天津大学 | Three-dimensional model retrieval method based on multi-mode fusion |
| CN112732956A (en) * | 2020-12-24 | 2021-04-30 | 江苏智水智能科技有限责任公司 | Efficient query method based on perception multi-mode big data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101719140B (en) | 2012-04-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101719140B (en) | Figure retrieving method | |
| Wang et al. | Lidar point clouds to 3-D urban models $: $ A review | |
| Mehra et al. | Abstraction of man-made shapes | |
| De Luca et al. | Reverse engineering of architectural buildings based on a hybrid modeling approach | |
| CN106780458B (en) | Point cloud framework extraction method and device | |
| CN104361632A (en) | Triangular mesh hole-filling method based on Hermite radial basis function | |
| CN109344533B (en) | Method for establishing underground working well cable network model | |
| CN105631932A (en) | Three-dimensional model re-construction method with contour line guidance | |
| CN115661374B (en) | Rapid retrieval method based on space division and model voxelization | |
| Raina et al. | Sharpness fields in point clouds using deep learning | |
| Shah et al. | Simulated annealing-based fitting of CAD models to point clouds of mechanical parts’ assemblies | |
| CN104715507A (en) | Automatic construction method for three-dimensional geographic entity based on curved surface slice | |
| Hu et al. | Geometric feature enhanced line segment extraction from large-scale point clouds with hierarchical topological optimization | |
| Zhang et al. | 3D human body skeleton extraction from consecutive surfaces using a spatial–temporal consistency model | |
| Athanasiadis et al. | Feature-based 3d morphing based on geometrically constrained sphere mapping optimization | |
| Zhou et al. | Distributed optimization based on graph filter for ensuring invariant simplification of high-volume point cloud | |
| Kidner et al. | Multiscale terrain and topographic modelling with the implicit TIN | |
| Huang et al. | Automatic CAD model reconstruction from multiple point clouds for reverse engineering | |
| Huang et al. | Fast texture synthesis for discrete example-based elements | |
| Pastor et al. | 3D wavelet-based multiresolution object representation | |
| Zhao et al. | Automatically modeling piecewise planar furniture shapes from unorganized point cloud | |
| Zakharov et al. | Synthesis of three-dimensional models from drawings based on spectral graph theory | |
| Liu et al. | A survey on processing of large-scale 3D point cloud | |
| Yu et al. | Example-based Road Network Synthesis. | |
| Ma et al. | Research and application of personalized human body simplification and fusion method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120418 Termination date: 20141223 |
|
| EXPY | Termination of patent right or utility model |