CN114078186A - Three-dimensional shape reconstruction simulation method based on infinite focus scanning - Google Patents
Three-dimensional shape reconstruction simulation method based on infinite focus scanning Download PDFInfo
- Publication number
- CN114078186A CN114078186A CN202010837230.9A CN202010837230A CN114078186A CN 114078186 A CN114078186 A CN 114078186A CN 202010837230 A CN202010837230 A CN 202010837230A CN 114078186 A CN114078186 A CN 114078186A
- Authority
- CN
- China
- Prior art keywords
- image
- point cloud
- cloud data
- simulation
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004088 simulation Methods 0.000 title claims abstract description 66
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 28
- 238000011156 evaluation Methods 0.000 claims abstract description 15
- 238000013507 mapping Methods 0.000 claims abstract description 13
- 238000005259 measurement Methods 0.000 claims abstract description 13
- 238000012545 processing Methods 0.000 claims abstract description 13
- 238000005070 sampling Methods 0.000 claims abstract description 12
- 238000012876 topography Methods 0.000 claims description 12
- 238000011084 recovery Methods 0.000 claims description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 238000013441 quality evaluation Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/05—Geographic models
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Remote Sensing (AREA)
- Computer Graphics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
The invention provides a three-dimensional shape reconstruction simulation method based on infinite focus scanning, which comprises the steps of constructing a three-dimensional model, and acquiring a real texture image of the surface of an object; sampling equidistant points on the surface of the model according to the image resolution to obtain real point cloud data; processing the real point cloud data, mapping textures, simulating an image acquisition process of a microscope, and generating a sequence simulation image; and performing three-dimensional reconstruction on the sequence simulation image to generate simulation point cloud data. The method can establish an arbitrary simulation measurement model with continuous surface, simulate complex and changeable surface morphology, obtain real point cloud data of the complex model surface through a point sampling algorithm, compare reconstructed point cloud data with real point cloud data, and quantitatively evaluate the quality of a focus evaluation algorithm.
Description
Technical Field
The invention relates to the field of microscopic vision three-dimensional precision measurement, in particular to a three-dimensional shape reconstruction simulation method based on infinite focus scanning.
Background
The surface morphology refers to the microcosmic surface geometric characteristics of roughness, waviness, texture and the like of the surface of an object, the optical measurement technology of the surface morphology directly measures the regional morphology of the surface of the object in a non-contact mode and reconstructs a three-dimensional structure, and the focusing morphology recovery technology belongs to one of microcosmic non-contact optical measurement technologies and has the advantages of no damage to the measurement surface, large measurable inclination angle of the surface (which can reach 80 degrees), capability of providing surface color information and the like. The method mainly comprises a focusing evaluation algorithm and a three-dimensional reconstruction algorithm, and utilizes the characteristic of limited depth of field of a microscope to shoot a group of sequence images in the process that an object moves longitudinally relative to an optical system of the microscope and record the longitudinal height information of the shot images at the same time. In the moving process, each pixel point in the image can go through the process from blurring to sharpness to blurring. The focus morphology recovery algorithm is used for evaluating the definition of each pixel point in an image, fitting the definition evaluation value, and finally obtaining the depth information of each point, so that the three-dimensional reconstruction data of the microscopic scene is obtained.
Regarding the quality evaluation of the focus profile restoration algorithm, a reliable conclusion can be reached by analyzing the difference between the reconstructed data and the real data. However, it is difficult to obtain the true depth information of the surface of the measurement object, which makes the verification of the effect of the new algorithm difficult. When scholars propose a new focus evaluation algorithm, a set of simulation data and a set of real data are usually set to verify the effect of the algorithm. The existing simulation data acquisition mode is mainly an image out-of-focus simulation algorithm, and when the algorithm generates a simulation image, the calculated point spread function has limitation, and the difficulty of changing a simulation measurement model is high.
Disclosure of Invention
The invention aims to provide a three-dimensional shape reconstruction simulation method based on infinite focus scanning, aiming at the defects of the prior art, a three-dimensional model is constructed, and a real texture image of the surface of an object is collected; sampling equidistant points on the surface of the model according to the image resolution to obtain real point cloud data; processing the real point cloud data, mapping textures, simulating an image acquisition process of a microscope, and generating a sequence simulation image; and performing three-dimensional reconstruction on the sequence simulation image to generate simulation point cloud data. The method can establish an arbitrary simulation measurement model with continuous surface, simulate complex and changeable surface morphology, obtain real point cloud data of the complex model surface through a point sampling algorithm, compare reconstructed point cloud data with real point cloud data, and quantitatively evaluate the quality of a focus evaluation algorithm.
The technical scheme of the invention is as follows:
a three-dimensional topography reconstruction simulation method based on infinite focus scanning comprises the following steps:
constructing a virtual measurement model, wherein the virtual measurement model consists of a plurality of sheet bodies and is used for simulating the surface appearance of a measurement object;
acquiring a texture image of the surface of the measured object through a microscope;
sampling equidistant points on the surface of the virtual measurement model according to the resolution of the texture image to obtain real point cloud data of the surface of the virtual measurement model;
processing the real point cloud data, mapping textures, simulating an image acquisition process of a microscope, and generating a sequence simulation image;
and performing three-dimensional reconstruction on the sequence simulation image through a focusing morphology recovery algorithm to generate simulation point cloud data.
Preferably, the three-dimensional shape reconstruction simulation method further includes:
after generating the simulation point cloud data, comparing the simulation point cloud data with the real point cloud data, and evaluating the precision of the focusing evaluation algorithm.
Preferably, of said sheetx、yThe size of the direction corresponds to the size of the texture image.
Preferably, the acquiring real point cloud data of the virtual measurement model surface comprises: converting the constructed sheet model file into STL triangular patch file, and outputting all triangular patchesx、yPoints whose coordinates are integers.
Preferably, the processing the real point cloud data and mapping the texture, simulating an image acquisition process of a microscope, and generating the sequence simulation image includes the following steps:
s1, calculating points according to the formula (1) ((x，y) Point spread image of (1)S x y（,）The point spread imageS x y（,）Convolution of the point spread function with the texture image:
wherein:h PSF (x，y) Is a point (x，y) The point spread function of (a) is,
is a texture image;
s2, calculating point spread images of all points on the surface of the measured object, and accumulating according to a formula (2) to obtain a sequence simulation image:
wherein:Wfor the width of the texture image,His the height of the texture image and,
for simulating images in
The value of (a) is (b),
is a point (i,j) Point spread image of (1) in
The value of (a) is (b),
is a point (i,j) Point spread function ofh PSF (x，y) In that
The value of (c).
Preferably, the processing the real point cloud data and mapping the texture, simulating an image acquisition process of a microscope, and generating the sequence simulation image further includes the following steps:
s3, Gaussian noise is added to the simulated image according to the formula (3), and a sequence simulated image containing the noise is obtained:
wherein:
in order to add the simulated image of the noise,
a is a random quantity following a standard normal distribution, and a is a noise control coefficient used for controlling the noise level.
Preferably by root mean square error
Evaluating the accuracy of the focus evaluation algorithm:
wherein:
is a real point cloud
The depth value of (a) is determined,
for simulating point cloud
The depth value of (a) is determined,
is the total number of points.
Compared with the prior art, the invention provides a three-dimensional shape reconstruction simulation method based on infinite focus scanning, which is used for constructing a three-dimensional model and acquiring a real texture image of the surface of an object; sampling equidistant points on the surface of the model according to the image resolution to obtain real point cloud data; processing the real point cloud data, mapping textures, simulating an image acquisition process of a microscope, and generating a sequence simulation image; and performing three-dimensional reconstruction on the sequence simulation image to generate simulation point cloud data. The method can establish an arbitrary simulation measurement model with continuous surface, simulate complex and changeable surface morphology, obtain real point cloud data of the complex model surface through a point sampling algorithm, compare reconstructed point cloud data with real point cloud data, and quantitatively evaluate the quality of a focus evaluation algorithm.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a flowchart of a three-dimensional topography reconstruction simulation method based on infinite focus scanning according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a point sampling process of a three-dimensional topography reconstruction simulation method based on infinite focus scanning according to an embodiment of the present application;
fig. 3 is a sequence simulation image of a three-dimensional topography reconstruction simulation method based on infinite focus scanning according to an embodiment of the present application;
fig. 4 is a schematic diagram of comparing root mean square errors of a three-dimensional topography reconstruction simulation method based on infinite focus scanning according to an embodiment of the present application.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Unless the context clearly dictates otherwise, the elements and components of the present invention may be present in either single or in multiple forms and are not limited thereto. Although the steps in the present invention are arranged by using reference numbers, the order of the steps is not limited, and the relative order of the steps can be adjusted unless the order of the steps is explicitly stated or other steps are required for the execution of a certain step. It is to be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
As shown in fig. 1, 2 and 3, a three-dimensional topography reconstruction simulation method based on infinite focus scanning includes the following steps:
constructing a virtual measurement model, wherein the virtual measurement model consists of a plurality of sheet bodies and is used for simulating the surface appearance of a measurement object;
acquiring a texture image of the surface of the measured object through a microscope;
sampling equidistant points on the surface of the virtual measurement model according to the resolution of the texture image to obtain real point cloud data of the surface of the virtual measurement model;
processing the real point cloud data, mapping textures, simulating an image acquisition process of a microscope, and generating a sequence simulation image;
and performing three-dimensional reconstruction on the sequence simulation image through a focusing morphology recovery algorithm to generate simulation point cloud data.
In the embodiment of the application, the virtual measurement model can be a common cone, and can also be complex models such as a cutter and a triangular cone.
The three-dimensional shape reconstruction simulation method further comprises the following steps:
after generating the simulation point cloud data, comparing the simulation point cloud data with the real point cloud data, and evaluating the precision of the focusing evaluation algorithm.
Of the sheet bodyx、yThe size of the direction corresponds to the size of the texture image.
The acquiring real point cloud data of the virtual measurement model surface comprises: converting the constructed sheet model file into STL triangular patch file, and outputting all triangular patchesx、yPoints whose coordinates are integers.
The steps of processing the real point cloud data, mapping textures, simulating an image acquisition process of a microscope, and generating a sequence simulation image comprise the following steps:
s1, calculating points according to the formula (1) ((x，y) Point spread image of (1)S x y（,）The point spread imageS x y（,）Convolution of the point spread function with the texture image:
wherein:h PSF (x，y) Is a point (x，y) The point spread function of (a) is,
is a texture image;
s2, calculating point spread images of all points on the surface of the measured object, and accumulating according to a formula (2) to obtain a sequence simulation image:
wherein:Wfor the width of the texture image,His the height of the texture image and,
for simulating images in
The value of (a) is (b),
is a point (i,j) Point spread image of (1) in
The value of (a) is (b),
is a point (i,j) Point spread function ofh PSF (x，y) In that
The value of (c).
The processing and texture mapping of the real point cloud data, the image acquisition process of a microscope simulation, and the generation of the sequence simulation image further comprise the following steps:
s3, Gaussian noise is added to the simulated image according to the formula (3), and a sequence simulated image containing the noise is obtained:
wherein:
in order to add the simulated image of the noise,
a is a random quantity following a standard normal distribution, and a is a noise control coefficient used for controlling the noise level.
By root mean square error
Evaluating the accuracy of the focus evaluation algorithm:
wherein:
is a real point cloud
The depth value of (a) is determined,
for simulating point cloud
The depth value of (a) is determined,
is the total number of points. As shown in FIG. 4, the root mean square error is calculated for two typical focus evaluation algorithms sml and glv in comparison
The quality of both focus evaluation algorithms can be evaluated quantitatively.
Compared with the prior art, the invention provides a three-dimensional shape reconstruction simulation method based on infinite focus scanning, which is used for constructing a three-dimensional model and acquiring a real texture image of the surface of an object; sampling equidistant points on the surface of the model according to the image resolution to obtain real point cloud data; processing the real point cloud data, mapping textures, simulating an image acquisition process of a microscope, and generating a sequence simulation image; and performing three-dimensional reconstruction on the sequence simulation image to generate simulation point cloud data. The method can establish an arbitrary simulation measurement model with continuous surface, simulate complex and changeable surface morphology, obtain real point cloud data of the complex model surface through a point sampling algorithm, compare reconstructed point cloud data with real point cloud data, and quantitatively evaluate the quality of a focus evaluation algorithm.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Furthermore, it should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art should integrate the description, and the embodiments may be combined as appropriate to form other embodiments understood by those skilled in the art.
Claims (7)
1. A three-dimensional topography reconstruction simulation method based on infinite focus scanning is characterized by comprising the following steps:
constructing a virtual measurement model, wherein the virtual measurement model consists of a plurality of sheet bodies and is used for simulating the surface appearance of a measurement object;
acquiring a texture image of the surface of the measured object through a microscope;
sampling equidistant points on the surface of the virtual measurement model according to the resolution of the texture image to obtain real point cloud data of the surface of the virtual measurement model;
processing the real point cloud data, mapping textures, simulating an image acquisition process of a microscope, and generating a sequence simulation image;
and performing three-dimensional reconstruction on the sequence simulation image through a focusing morphology recovery algorithm to generate simulation point cloud data.
2. The infinite focus scanning-based three-dimensional topography reconstruction simulation method according to claim 1, further comprising:
after generating the simulation point cloud data, comparing the simulation point cloud data with the real point cloud data, and evaluating the precision of the focusing evaluation algorithm.
3. The infinite focus scanning-based three-dimensional topography reconstruction simulation method according to claim 1, wherein the sheet body is made of a material having a specific shapex、yThe size of the direction corresponds to the size of the texture image.
4. The infinite focus scanning-based three-dimensional topography reconstruction simulation method according to claim 1, wherein the obtaining of the real point cloud data of the virtual measurement model surface comprises: converting the constructed sheet model file into STL triangular patch file, and outputting all triangular patchesx、yPoints whose coordinates are integers.
5. The method for reconstructing and simulating three-dimensional topography based on infinity-focused scanning according to claim 1, wherein the step of processing the real point cloud data and mapping texture to simulate the image acquisition process of a microscope and generating the sequence simulation image comprises the following steps:
s1, calculating points according to the formula (1) ((x，y) Point spread image of (1)S x y（,）The point spread imageS x y（,）Convolution of the point spread function with the texture image:
wherein:h PSF (x，y) Is a point (x，y) The point spread function of (a) is,
is a texture image;
s2, calculating point spread images of all points on the surface of the measured object, and accumulating according to a formula (2) to obtain a sequence simulation image:
wherein:Wfor the width of the texture image,His the height of the texture image and,
for simulating images in
The value of (a) is (b),
is a point (i,j) Point spread image of (1) in
The value of (a) is (b),
is a point (i,j) Point spread function ofh PSF (x，y) In that
The value of (c).
6. The method of claim 5, wherein the processing the real point cloud data and mapping texture to simulate the image acquisition process of a microscope, and generating the sequence simulation image further comprises the following steps:
s3, Gaussian noise is added to the simulated image according to the formula (3), and a sequence simulated image containing the noise is obtained:
wherein:
in order to add the simulated image of the noise,
a is a random quantity following a standard normal distribution, and a is a noise control coefficient used for controlling the noise level.
7. The method of claim 2, wherein the three-dimensional topography reconstruction simulation method based on the infinite focus scan is performed by root mean square error
Evaluating the accuracy of the focus evaluation algorithm:
wherein:
is a real point cloud
The depth value of (a) is determined,
for simulating point cloud
The depth value of (a) is determined,
is the total number of points.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010837230.9A CN114078186A (en) | 2020-08-22 | 2020-08-22 | Three-dimensional shape reconstruction simulation method based on infinite focus scanning |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010837230.9A CN114078186A (en) | 2020-08-22 | 2020-08-22 | Three-dimensional shape reconstruction simulation method based on infinite focus scanning |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114078186A true CN114078186A (en) | 2022-02-22 |
Family
ID=80282680
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010837230.9A Pending CN114078186A (en) | 2020-08-22 | 2020-08-22 | Three-dimensional shape reconstruction simulation method based on infinite focus scanning |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114078186A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116045852A (en) * | 2023-03-31 | 2023-05-02 | 板石智能科技(深圳)有限公司 | Three-dimensional morphology model determining method and device and three-dimensional morphology measuring equipment |
| CN117824497A (en) * | 2023-12-26 | 2024-04-05 | 宁夏亿博丰担保品管理有限公司 | Intelligent silage volume measuring method and system |
-
2020
- 2020-08-22 CN CN202010837230.9A patent/CN114078186A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116045852A (en) * | 2023-03-31 | 2023-05-02 | 板石智能科技(深圳)有限公司 | Three-dimensional morphology model determining method and device and three-dimensional morphology measuring equipment |
| CN117824497A (en) * | 2023-12-26 | 2024-04-05 | 宁夏亿博丰担保品管理有限公司 | Intelligent silage volume measuring method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112002014B (en) | Fine structure-oriented three-dimensional face reconstruction method, system and device | |
| CN112258390B (en) | High-precision microscopic virtual learning resource generation method | |
| CN109242828A (en) | 3D printing product 3 D defects detection method based on optical grating projection multistep phase shift method | |
| CN111783798B (en) | Mask generation method for simulated residual point cloud based on significance characteristics | |
| CN110517348A (en) | Target object three-dimensional point cloud method for reconstructing based on display foreground segmentation | |
| CN111047698A (en) | Real projective image acquisition method | |
| CN114078186A (en) | Three-dimensional shape reconstruction simulation method based on infinite focus scanning | |
| CN114972332A (en) | Bamboo laminated wood crack detection method based on image super-resolution reconstruction network | |
| CN108171790A (en) | A kind of Object reconstruction method based on dictionary learning | |
| CN116596824B (en) | Multi-camera three-dimensional surface model fusion method | |
| CN113358061A (en) | Single stripe three-dimensional point cloud measuring method for end-to-end calibration of deep learning network | |
| CN113144613A (en) | Model-based volume cloud generation method | |
| CN112562067A (en) | Method for generating large-batch point cloud data sets | |
| Sainz et al. | A simple approach for point-based object capturing and rendering | |
| CN111028349A (en) | Hierarchical construction method suitable for rapid visualization of massive three-dimensional live-action data | |
| CN112002019B (en) | Method for simulating character shadow based on MR mixed reality | |
| Silva et al. | Real-time acquisition and super-resolution techniques on 3D reconstruction | |
| CN115619974A (en) | Large scene three-dimensional reconstruction method, reconstruction device, equipment and storage medium based on improved PatchMatch network | |
| CN107895398A (en) | With reference to the embossment edit methods of vision significance | |
| Liu et al. | Benchmarking large-scale multi-view 3D reconstruction using realistic synthetic images | |
| Ohtake et al. | A composite approach to meshing scattered data | |
| KR101673442B1 (en) | The method and apparatus for remeshing visual hull approximation by DBSS(displaced butterfly subdivision surface) | |
| Kang et al. | Simplification method of photogrammetry building models based on vectorization techniques | |
| Tognola et al. | Three-dimensional laser scanning and reconstruction of ear canal impressions for optimal design of hearing aid shells | |
| CN116883550B (en) | Three-dimensional virtual live-action animation display method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20220222 |
|
| WD01 | Invention patent application deemed withdrawn after publication |